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DISTANCE LEARN I N6 IN NORTH DAKOTA: A CROSS-TECHNOLOGY 
STUDY OF THE SCHOOLS, ADMINISTRATORS, COORDINATORS, 
INSTRUCTORS, AND STUDENTS 



INTRODUCTION 

Among its more unique attributes, North Dakota prides itself in the 
ingenuity of its people—its pioneer spirit in an age of decreasing rugged 
individualism. So it is not unlikely that a state such as North Dakota has 
jumped head-first into the several forms of distance learning, neither 
dragging its feet over regulatory measures nor dictating which forms of 
distance learning will be adopted. 

Not that North Dakota has acted serendipitously— the need for 
curriculum expansion in light of greater requirements has certainly 
prompted the exploration into distance learning. One-third of North 
Dakota's high schools have enrollments fewer than 50 students; two- 
thirds have fewer than 100 students. A significant number of districts 
have difficulty implementing art, foreign language, or advanced science 
and math programs through traditional means. Less than two-thirds of the 
high school districts offer a foreign language course; one-fourth have no 
advanced math class; one-third have no Physics and/or Chemistry course; 
and less than 40% include an art class in their curriculum. 

Having suffered decreased state funding for education, largely 
because of a prolonged slump in energy and crop prices, North Dakota's 
1988 state appropriation of $346.4 million was $42 million less than was 
spent on public schools in 1981. Foundation Aid to North Dakota schools 
alone dropped from $184.4 million in 1981-82 to a low of $171 million in 
1989-90, a gradual decrease of more than $13 million dollars to the 
state's schools in the nine-year span . This has further exacerbated the 
problem of implementing a broader curriculum. School districts have 
found their budgets necessarily sliced by significant percentages and are 
unable to hire additional teachers even if teachers were available. With 
40% of their budget coming from local/county sources, the economically 
difficult times of the last few years has not allowed an increase in taxes, 
regardless of need. 



Faced with no alternative, 32 North Dakota schools hove been forced 
to close or consolidate over the last decade. In spite of the bleak picture 
painted by the region's economics, however, North Ookoto has a history of 
strong family and community support for education. This, perhaps, is best 
illustrated by the state dropout rate. North Dakota has one of the lowest 
dropout rates in the country— a distinction shored only by Minnesota and 
Wyoming. North Dakota's current annual dropout rate is 1.77X, with a 
1988-89 four-year persistence to graduation rate of 92.85%. This 
undeniably strong value placed on education has led North Dakotans to seek 
other solutions to their unrelenting problems. 

The rational interest in distance learning in North Dakota came 
about in 1987 with seven districts' involvement with German .by Satellite 
offered through Oklahoma State University. Technology conferences put 
together by the Department of Public Instruction and Mid-Continent 
Regional Educational Laboratory served to further increase awareness of 
the technological options available— Audiographic Tele-learning and two- 
way Interactive Television— in addition to Instruction by Satellite by the 
several national providers available. 

During the 1989-90 school year, 27 public and 1 private North 
Dakota secondary schools were involved in distance learning programs: 



• 12 high schools utilized instruction by Satellite 

— 2 withTI-IN Network 

— 5 with SERC (Satellite Educational Resources Consortium) 

— 5 with Oklahoma State University's Arts and Sciences 
Teleconferencing Service (ASTS) 

• 9 high schools utilized two-way Interactive Television 

— 4 with an Analog system 

— 5 with a Digital system 

• 7 high schools utilized an Audiographic Tele-learning system 



A list of North Dakota schools currently operating a distance 
learning program is included in the following table: 
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TABLE 1 

NORTH DAKOTA DISTANCE LEARNING PROJECTS 

1989-90 



Consortium/School 
West River 



Technology 
Analog I -TV 



Participant Schools 
Beulah, Center, Hazen, 
Stanton 



Souris Loop 



Digital l-TV 



Velva, Sawyer, 
Towner, Karlsruhe, 
Granville 



Red River (OSU) 



Instr. by Satellite 



Central Valley, Hatton, 
Shanley, Richland, 
Mayville-Portland 



SERC 



Instr. by Satellite 



Fargo South, Fargo 
North, Mandan, Dakota, 
New Town 



TI-IN 



Instr. by Satellite Alexander, Drayton 



Missouri Valley 



Audiographic Instr. 



Turtle Lake, Garrison, 
Riverdale, Underwood, 
Washburn, Wilton, 
Century High 



Courses offered through one of the three distance learning 
technologies included: Spanish I, German I, Art 1, Russian 1, 
Anatomy/Physiology, Psychology/US History, Advanced Economics, 
Parenting/Child Development, Japanese I, Accounting II, AP Micro/Macro 
Economics, Speed Writing, Advanced English, German II, Accounting III, Art 
History/Appreciation, French, and Latin. North Dakota student enrollments 
in each can be seen in the following table: 
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TABLE 2 

DISTANCE LEARNING COURSES OFFERED IN NORTH DAKOTA 

Students Enrolled 

Courses Offered 

Spanish I 



Technology 

Analog I -TV 



Digital l-TV 



Satellite 
(OSU) 



Satellite 
(SERC) 



2nd Sem 1989-90 Total 

23 



US History 
German i 
Adv. Biology 
Accounting II 
Child Dev 



Speed Writing 
Spanish S 
Art I 

Adv. English 
Accounting III 



German I 
German II 
Adv. Economics 



Japanese I 
Russian I 

AP Micro Economics 



21 
38 
21 
13 
13 



12 
20 
15 
18 

3 



33 
8 
15 



13 
20 
11 



129 



68 



56 



44 



Satellite 
(TI-IN) 



Spanish I 
Japanese 1 
Latin 
French I 

Art Appreciation 



2 
1 
1 

2 
3 



Audiographic 



Spanish 



28 



23. 



TOTAL STUDENTS 



334 
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METHODOLOGY 



In hay, 1988 a research study was initiated involving all schools in 
Missouri and North Dakota who had implemented German by Satellite from 
Oklahoma State University. The purpose of the study was to look at 
distance learning programs in an evaluative light in order to help both 
previous and potential adopters understand the methods of implementation 
most closely related to student success and to understand what other 
factors are involved in successfully implementing a distance learning 
project. Questionnaires were administered in both states to: (1) the 
administator of each school responsible for initiating the program; (2) the 
program coordinator, e.g., the person in the local classroom responsible 
for coordinating or supervising the course; (3) each student enrolled in 
German I by Satellite; and (4) a parent of each enrolled student. In 
addition, students were given a standardized German test to be used as a 
relative measure of achievement against which input variables could be 
weighed. Research findings were compiled in Distance Learning 
Evaluation Study (Report J i): An inter- and intrastate Comparison 
(published by Mid-Continent Regional Educational Laboratory) which 
detailed the study's findings and set forth recommendations to adopters of- 
instruction by satellite programs. 

With the upsurgence of multiple forms of distance learning across 
North Dakota, a second research study was undertaken by McREL in April, 
1990. This time the focus of the study was the comparative analysis of 
North Dakota student achievement across the three major forms of 
distance learning— Instruction by Satellite, Audiographic Tele-learning, 
and two-way Interactive Television. With the assistance of the North 
Dakota Department of Public Instruction and Mayville State University, 
questionnaires were mailed to: (1) the administator of each school most 
familiar with the program; (2) the program coordinator, e.g., the person in 
the local school responsible for coordinating or supervising the course; (3) 
each student enrolled in all distance learning courses; and (4) the remote 
instructors involved in each course originating in North Dakota. In 
addition, national standardized tests were administered to all North 
Dakota distance learning students enrolled in either Spanish I or German I 
by any of the various forms of distance learning. The two language 
courses, in which standardized tests were administered, were chosen 
because of the larger number of students enrolled in those courses, the 
existence of a national standardized test in those subjects, and the 
offering of the course across multiple DL technologies. 
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The study involved 27 of the 23 North Dakota districts having 
implemented some form of distance learning— one private high school 
chose to not participate in the study. Completed questionnaires were 
received from 24 of the 27 administrators (89%), 23 of the 27 project 
coordinators (85%), 12 of the 12 remote instructors (100%), and 275 of 
the 334 students involved (82%). Achievement test data was received 
from 56 of the 72 Spanish i students (78%) and 63 of the 71 German I 
students (89%). 

Appropriate caution should be taken with tentative conclusions 
based on relatively small numbers of cases. Definitive conclusions must 
await a multi-state or national study involving a greater number of 
schools, programs, and students. 

The following results are organized around four major topics, 
corresponding to the respondents of sach questionnaire. The 
administrator questionnaire dealt largely with the history of the 
project— including costs involved in project implementation— the 
administrator, school, and community attitudes toward the project, and 
the future of distance learning in their school. As an addendum to the 
administrator questionnaire, respondents were asked to complete 
information for each enrolled student concerning GPA, rank in class, 
student motivation level, and 1st and 2nd semester course grades. The 
coordinator questionnaire dealt more specifically with how the 
course(s) was(were) implemented in each school, what components were 
built into each program, and the role played by the coordinator in each 
school. The student questionnaire was primarily attitudinal in nature, 
trying to ascertain how the student felt about the distance learning 
course, their assessment of the distance learning course as compared to 
traditionally taught courses, and some demographic information about the 
student. The remote instructor questionnaire attempted to identify, 
some of the major factors involved in implementing such a course, its 
comparison with traditionally taught courses from the instructors' point 
of view, and any problems or limitations seen with the technology. 
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DISTANCE LEARNING STUDENT DATA 



Remote Site vs. Site of Origin 

Two hundred seventy-five students responded to the distance 
learning questionnaire, representing all technologies having been 
implemented in the state. Seventy-two percent (72%) of the students 
attended "remote site" schools, meaning they were enrolled at sites in 
which the course instructor was not physically present; twenty-nine 
percent (29%) of the students attended schools from which the distance 
learning course originated, i.e., an l-TV or audiographic class in which the 
DL teacher broadcast from their school. 

Student Reasons for Enrolling 

Students were asked to identify their reasons for enrolling in the 
distance learning class. Reassuringly, 84% indicated they enrolled 
because they were interested in the subject. Sixty percent (60%) said it 
was the only way they could take the course— remember that some 
students were enrolled in sitss of origin in which the class may have been 
offered traditionally as well as by distance learning. Thirteen percent 
(13%) said someone else had been responsible for them enrolling in the 
course, most usually a friend, superintendent, or principal. Eighty-six 
percent (86%) of the students indicated they would have enrolled if the 
class had been offered as a regular high school course. 

TABLE 3: Students' Reasons for Enrolling in the Distance Learning Coarse 

* of Students Responding 





M 


No 


1 ves interested in the subject 


84* 


14* 


It sounded exciting 


75* 


23* 


It ves the only vay 1 could take the course 


60* 


37* 


1 needed it for college 


45* 


53* 


1 prefer DL over a regular class 


16* 


79* 


1 like vor ki ng on computers 


14* 


34* 


It wasn't my idea to enroll in the class, . . 


13* 


83* 



someone else persuaded me to enroll 

Student Attitudes Toward Distance Learning 

Seventy-nine percent (79%) said they would enroll in another 
distance learning course if given the opportunity; 20% said they probably 
would not enroll in another course; the remainder were undecided. 
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Distance learning students were asked to assess the difficulty level 
of the course compared to regular classes. Slightly over half of the 
students (56%) said it was about the same level of difficulty,, while 10% 
felt it was easier and 34% felt it was harder. 

Asked to assess the amount of homework given as compared to 
regular classes, 58% said the amount of homework was about the same, 
while 15% believed there was more homework and 28% believed there was 
less homework. 



TABLE 4: Steeeot Assessment of Coarse Dlfflcolte. aod Aaooot of Hoaovork 



Lew than reg. close 
Mora than rag. class 
Sams as rag. class 



Laval of Difficulty 




Amount of Homework 


of Course 




Given 


% Of Students Resoondi ra 


% of Students Resoondi no 



27% 
15% 
58% 



Easier than reg. class 1 0% 

Harder than reg. class 34% 
Some as reg. class 56% 



Characteristics of Distance Learning Students 
• Grade Level 

The majority of students enrolled in distance learning classes were 
high school juniors (25%) or seniors (48%). The remaining 
27% were evenly divided between 9th and 10th graders. 

Diagram 1: Grade Level of Enrolled Students 




Grooo Level *of Staeoete 

■ 9th 125* 
Q 10<h 14.855 

■ llth 25.1* 
□ 12th 47.6* 



17 

8 



• Grade Categorization 

All distance learning students were asked to categorize themselves 
as either an "A", "A-B", "C", or "D" student. The following table shows both 
how students categorized themselves and also how the school reported 
their grade point averages in the study. 

TABLE 5: Student and School Cateoerizatioa of Overall Stodeat Grades 

As students reported ( As school reported 

3995 3.5-4.00 GPA 



"A" Student 25% 

"A-B" Student 5295 

X" Student 2295 

"D" Student 195 



2295 3.0- 3.49 GPA 

2996 2.0- 2.99 GPA 
1095 0.0- 1.99 GPA 
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The only significant difference in categorization is the extent to 
which students undercounted themselves on both extremes, that is "A" 
students tended to lump themselves with "A-B" students and "D" students" 
tended to elevate themselves to "C" students. The breakdown of students, 
however, is probably fairly typical of the student body as a whole, perhaps 
with a slightly increased percentage of "A" students taking— or being 
steered into— distance learning courses. 

Plans for College 

Nearly all of the students enrolled in distance learning courses 
(95%) indicated that they planned on going to college, as might be 
expected given the nature of the courses offered. 

Hours Soent Studuinq 

Out-of-class time spent studying for the distance learning class 
was surprisingly low with 25% spending no time and 60% of the students 
spending 2 or fewer hours per week. Only \1% spent three or more hours 
studying per week. 

TABLE 6: Amount of Time Students Spent Studying for Distance Learning Classes 

Percent of Students 
None 2395 
1 - 2 hours per week 6095 
3-5 hours per week 1695 
6- 1 0 hours per veek 1 95 
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Amount Learned 

Students were asked their perception of how much they felt they had 
learned In the distance learning course. Perceptions were very positive 
with 74% Indicating they had learned "a great deal" or "an acceptable 
amount". Eighteen percent (18%) said "not as much as I think I should 
have", while 8% said "not much at all". 



Diagram 2 
Student Perception of Amount Learned 




Components of Class on Which Students Most Relied 

Textbooks were cited as the primary source of Information by 39% 
of the students, while the TV classes were ranked first by 28* and 
workbooks/worksheets by 11%. Class or technology specific components, 
e.g., computer software/dialogue, Voice-Based Learning System, and 
audiotapes, ranked somewhat lower, as would be expected due to their 
more limited use! 



Student-Teacher Interaction 

The amount of student Interaction with a teacher during doss time 
differed greatly among students. Forty-three percent (43%) reported 
never or rarely Interacting with the teacher, while 26% reported teacher 
Interaction more than three times per week. (Method of Interaction was 
obviously highly dependent on the type of the distance learning technology 
Implemented.) 

Outside of class time, student Interaction with teachers was low, 
as would have been expected, but undoubtedly higher than In traditional 
classes. Seventeen percent (17%) of all students ha*! some acade .c- 
related contact with their teacher outside of class time. 



ioJS 



Diagram 3 
Student-Teacher Interaction 

130 • 




Rarely One*/ 2-3 times/ One*/ 2-3 times/ Mor* often 
Month Month V«k V**k 



Frequency of Student-Teacher Interaction 

□During Ctessttrw SOutsid* of Class 



Student Per ception of Attributes Most Heloful in a D L Class 

Interestingly, both an aptitude for or interest in technical 
equipment and an above average intelligence level were seen by students 
as least helpful in a distance learning class. More important in their 
estimation was the initiative to take responsibility for their own 
learning, a willingness to work on their own, and a high level of 
motivation. 

TABLE 7: Characteristics Sean as Mast Hslpfvl by Stndaats in a OL Class 

% of Students 



Talcing responsibility for my ovn learning 868 

A willingness to work on my own 82% 

A high level of motivation 735? 

An outgo! ng personality 6 1 % 

An interest in or aptitude for use of technical equipment 49% 

An above average i ntelligence level 49% 

Other £% 



Who Performs the Tasks Associated with Teaching in a PL Classroom 

Students were given a list of tasks which might be the 
responsibility of the teacher in a traditional classroom. They were asked 
who, if anyone, performed those tasks in their distance learning class. 
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TABLE 8: Student Assessment of Who Performs Specific Teaks in e DL Close 







Supervisor/ 




Combi- 




Not Applicable/ 




Teacher 


Coordinator Students 


nation* 


No one 


No Resume 


Motivates student to do veil 


48% 


9* 


15* 


14* 


13* 


1* 


Maintains discipline 


45* 


34* 


7* 


7* 


6* 


1* 


Assists students with computer use 


6* 


7* 


4* 


4* 


13* 


66* 


Assists students with modem or 


2% 


23* 


3* 


2* 


12* 


58* 


electronic mail 














Encourages students to talk with or 


26* 


16* 


8* 


11* 


38* 


1* 


call the teacher 














Assists students with software use 


9% 


11* 


3* 


2* 


13* 


63* 


Operates the satellite receiving or 


10* 


20* 


23* 


13* 


4* 


30* 


camera equipment 














Troubleshoots problems vith 


14* 


42* 


11* 


13* 


14* 


6* 


equipment 














Administers tests 


34* 


57* 


1* 


7* 


<1* 


1* 


Grades tests 


72* 


11* 


3* 


13* 


<1* 


1* 


Constructs quizzes or worksheets 


76* 


8* 


1* 


4* 


10* 


1* 


to assist student learning 














Identifies and solves problems 


58* 


10* 


6* 


12* 


13* 


1* 


individual students may be 














having with the course 














Learns the course material along 


NA 


19* 


«• « 


6* 


73* 


2* 


with the students 














Participates or watches all classes 


NA 


33* 




5* 


61* 


1* 


along with the students 














Answers simple questions or helps 


49* 


14* 


9* 


19* 


8* 


2* 



students find answers to problems 



The three primary tasks of the remote teacher or classroom 
coordinator, as assessed by the students, were administering/grading 
tests, constructing quizzes and worksheets, and maintaining discipline. 

The students themselves were primarily responsible for operation of 
the equipment. 

Of major importance, however, are the findings that 73* of the 
students report no one learning the course material along with them and. 
6\% report that no one else participated in or watched all classes along 
with them. 
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ADMINISTRATOR DATA 



Administrator Knowledge Of Distance Learning 

Instate conferences and other administrators were the primary sources 
from whirn North Dakota administrators learned about distance learning 
technologies. Nearly half of all administrators gained information, however, 
from professional journals and/or instate demonstration projects. 

TABLE 9: Soiree of Administrator Information a be at Distance Learning 



Thirty percent {30%) of the administrators initiating a distance 
learning program, however, explored no technology other than the one 
adopted. This is an important finding and strongly suggests the need for 
additional information which is readily and widely available to 
administrators. 

Ninety-one percent (9 \%) of the administrators received outside 
technical or consulting assistance in selecting or setting up their 
distance learning program. The following table details the source of 
consulting services received: 

TABLE 1 0: Source of Distance Learning Consul ting Services 



Percent of Administrators 



Instate Conferences 
Tel king with other Administrators 
Professional journals or publications 
Instate demonstration projects 
Technology Vendors or salespersons 
Out of state demonstration projects 
Out of state Conferences 
Other 



7055 
65* 
44* 
44% 
30* 
26% 
13* 

9* 



* of Admi natrators Utilizi no Conaultl ng Services 



Deportment of Public Instruction 

Equipment dealer or supplier 

Local telephone company 

Private Consultant 

Instate University or College 

Other 

Out of state University 



55* 
52* 
52* 
44* 
39* 
22* 
9* 
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The types of assistance which districts received ranged from 
selecting out-of-state course providers to determining the technical 
equipment necessary for their particular technology. Given that all of the 
technologies utilized some type of technical eqipment, it is of particular 
interest that only 78% of the administrators indicated they (or someone in 
their school) had received training in the use of technical equipment. 

TABLE 1 1 : Types of Assistance Received on Schools Adopting o Distance 

Leer-nine; Tecknolof y 

% of Administrators Receiving Assistance 



Deter mi ni ng Ihe technical equi pment necessary 93% 

Actually setting up technical equipment 83% 

Determining costs of implementing a distance learning course 8255 

Gat hen ng 1 nfor (nation on the technology 78% 

Determi ni ng vendor sources for technical equi pment 78% 

Trai ni ng i n use of technical equi pment 78% 

Determining costs of implementing a distance learning course 82% 

Training of local distance learning instructors 70% 

Selecii ng course providers 39% 



Existence of Technical Problems 

While 70% of the administrators indicated they had encountered 
technical problems with the distance learning equipment installed, most 
prevalent was the existence of video problems (as indicated by 26% of the " 
administrators) which were attributed to satellite dish positioning, 
distorted pictures, weak video signals, and satellite receiver controls. 
Audio problems, i.e., quality of phone lines and poor audio reception,, 
accounted for 17% of the problems mentioned by administators. other 
problems mentioned by single administrators included problems with 
computer software, loss of data, modulator/demodulator problems, and 
scheduling problems. 

Fifty-two percent (52%) of the administrators— accounting for 75% 
of those having experienced technical problems— indicated that the 
technical problems had been resolved to their satisfaction, while 17% 
indicated that the problem(s) remained. 

Future Use of Distance LeorninoJechnoloqij 

Administrators were asked to anticipate how their current DL 
technology would be utilized next year and five years from now, A 
significant percentage (17%) believed their schools to be in jeopardy 



within the next 5 years, but among other administrators all indicated a 
long-term growth in the role of distance learning technology. 

Also of interest is the 30% of adminstrators who indicated they 
anticipated switching to a different DL technology with the next five 
years and the 78% who alluded to the use of multiple OL technologies 
within the same time span. 

TABLE 1 2: Mnlaistrater Perception ef Future Us* sf DL TeciMlst % 

in Tbtir District 

% of Administrators 





Next Year 


Five Veers From Nov 


The same courses vill be offered 


61% 


48% 


The number of courses vill be expanded 


70% 


91% 


A larger number of students vill be served by DL 


70% 


78% 


Other uses of the technology vill be expanded 


83% 


83% 


to include: 






Teacher Inservice 


65% 


74% 


Community or business use 


48% 


65% 


Administrative or tnterschool use 


52% 


65% 


Student enrichment programming 


57% 


61% 


We vill 11 kel y svitch to a different OL technology 


0% 


30% 


We vill likely use multiple DL technologies 


44% 


78% 


We vill 11 kel y not use any DL technologies 


4% 


4% 


Our school may cease to exist 


4% 


17% 



Lack of financial resources topped the list of impediments to 
greater use of distance learning among administrators in the future, 
however three-fourths of the administrators felt that state level policies 
and regulations would impede their increased use of OL technologies. 
Eighty-st en percent (87%) of the administrators saw distance learning 
as a long-term solution to curriculum expansion and limited teacher 
availability. 
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TABLE 1 3: laipeaimtats ft Greater Use af DL Teefcaelea i la Taalr Ova Districts 
la tat Fatare (as assesses * a* Mariaistraters) 



% of Administrators 





Yes 


No 


The limitations of the local district budget 


94* 


6* 


Lack of outside funds to expand usage of distance learning 


88* 


12* 


technologies 






The costs of equipment maintenance and upkeep 


75* 


25* 


State level policies and regulations 


75* 


25* 


The obsolescence of existing equipment 


31* 


69* 


Lack of purchasable DL courses in needed subject areas 


29% 


71* 


Lack of good teachers villi ng to become distance learning 


29% 


71* 


instructors 






Cooperative hiring of teachers among districts will 


13* 


87* 


eliminate the need for it 






The attitude of the school board regarding technology 


12* 


88* 


Consolidation will eliminate the need for it 


6* 


94* 


The need for distance learning courses will cease to exist 


6* 


94* 


Teacher sur pi uses will eli mi nate the need for it 


0* 


100* 



AH administrators (100%) saw distance lemming as serving a long-term 
need for curriculum expansion in small schools. Nearly all administrators 
saw it playing a significant role as a means of teacher inservice training 
(96*) and as a source for adult education or community use (9\%). 



TABLE 14: Adariaistrator Perceptiaas af Par pases Served 
ba Distaace Learaiaa Tecaaeleaies 

* of Administrators 





YES 


MO 




A long-term need for expanding the curriculum 


100* 






offerings of small schools 








As a means of teacher inservice training in small districts 


96* 


4* 




As a source for adult education and for community use 


91* 


9* 




As a source of supplemental course offerings for larger 


87* 


13* 




school districts 








As a means for small schools to avoid or delay consolidation 


35* 


61* 


4* 


A short-term need for curriculum expansion until it 


17* 


83* 





becomes economically feasible to hire more teachers 



No K<aponse Given 
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School/Community Attitud e Toward Distance Learning 

The superintendent (who generally was the administrator responding 
to the questionnaire) expressed the most positive attitude regarding the 
distance learning program implemented, as might he expected. Little 
direct opposition existed for the program— according to the administrator 
—except in isolated situations involving a counselor, a community, and 
two high school faculties. 

TABLE 15: Mnisistratar Per»pt1aa ef Attltaato Rtfartfiftf Dlstaac* Learalaf 

im tba ScfcMl and Caananit« 

Attitudes Regarding Local Distance Learning Program 



Stronglu Stronglu 
Favorable Favorable Indifferent Opposed Opposed NR 



Your School Board 


48* 


52* 








Superintendent 


73* 


27* 








High School Principal 


44* 


52* 


4* 






High School Counselor 


35* 


44* 


13* 


4* 


4* 


High School Faculty 


9* 


52* 


30* 


9* 




Course Supervisor 


35* 


44* 






— 22** 


Course Instructor 


65* 


35* 








Students Enrolled in DL course(s) 


35* 


61* 


4* 






Parents/Community Members 


17* 


65* 


13* 


4* 





* The high rote of No Response among administrators on Course Supervisor attitudes undoubtedly 
reflects the lack of a supervisor or the limited role played by a supervisor in those schools. 

Administrators expressed their own level of satisfaction with their 
distance learning program on several specific aspects. While 96* of the 
administrators indicated they were satisfied or very satisfied with the 
course overall, primary areas of dissatisfaction, to the extent that they 
existed, included the "fit" or alignment with existing school curriculum, 
the technical quality of the course, the cost, support from DPI, and access 
to technical support. 
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TABLE 16: A*»1«1strater Satlsfactlaa With Distance Lear M if Prtfraw 

CtaiptMate 



* of Administrators 

Very Yery 
Sa&fM Satisfied Undecided Dissatisfied Dissatisfied NR 



Overall satisfaction with the program 


48* 


48* 


4* 








Selection of the course(s) 


17* 


61* 


8* 


4* 


4* 


4* 


Content of the course(s) 


30* 


61* 


9* 








Quality of instruction 


44* 


52* 


4* 








Technical quality of course(s) 


50* 


41* 




9* 






Cost as compared to other alternatives 


26* 


39* 


26* 


9* 






Level of difficulty for students 


22* 


74* 




4* 






Ease of supervision 


39* 


44* 


13* 


4* 






Access to good technical support 


26* 


57* 


9* 


9* 






Equipment upkeep and maintenance 


32* 


55* 


9* 


5* 






Ease of equipment operation 


39* 


52* 


4* 


4* 






Technical reliability of equipment 


23* 


59* 


14* 


5* 






Support from DPI 


14* 


55* 


23* 


9* 






Amount of knowledge students gai n 


26* 


65* 


9* 








"Fit: or alignment w.th the traditional 


35* 


48* 


4* 


13* 







school curriculum 



Factors Contributing to Decision to Adopt a Distance Learning Technology 
Administrators were asked about which factors contributed to the 
decision to adopt their particular distance learning technology. Topping the 
list was the opportunity for curriculum expansion and the ability to offer, 
courses with 1-2 students. The use of technology in education was a 
contributing factor for 83* of the administrators, but interestingly only 41 % 
gave any importance to the existence of a video-based instructional medium. 
Clearly, most administrators (78%) saw other options potentially available 
to them, either through traditional means, e.g., shared teachers, or through 
other distance learning technologies. Twenty-two percent (22*), however, 
apparently saw no other option available to them, either because of their 
remoteness, (i.e., eliminating the possibility of a shared teacher .«r 
attraction of any teacher), their lack of knowledge of other distance learning 
technologies, or cost, (i.e., limiting their access to other distance learning 
technologies). 
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TABLE 17: Factors Coot Mooting to School Derisioo to Mort DL Proo.ro* 



Administrator Reservations Regarding Distance Learning 

Now knowing what is involved with initiating and operating a distance 
learning course, all administrators (\00%) said they would recommend their 
particular technology to other districts. Nearly half of the administrators 
(48%) indicated no major reservations or problems with their distance 
learning program. The other half of the administrators indicated problems 
with funding (27% of all administrators), scheduling problems or enrollment 
deadlines (13%), inability of technology to replace a "live" classroom (9%), 
technical problems (4%), state regulations regarding course supervision 
(4%), lack of knowledge of classroom supervisor (4%), not enough live 
interaction with teacher (4%), and facilities for continued use and expansion 
(4%). 

Basis for Student Enrollment 

Administrators were asked to indicate the basis on which students 
were allowed to enroll in their distance learning courses. Seventy 
percent (10%) indicated that no restrictions were placed on student 
enrollment in distance learning courses, however, it is obvious that upper 
grade level students were steered into DL courses. Students were not 
routinely included or excluded on the basis of ability or motivation level, 
as indicated by the administrator responses. Only one-fifth of the schools 
selected students on the. basis of perceived ability and one-third on the 
basis of student motivation levels. 



* of Administrators 



Curriculum expansion opportunity for small schools 

Courses could be offered vith 1 - 2 students at any one site 

Grant funds were available for it 

Use of technology i n education 

It seemed to be a viser long-term investment 

Ability to drop or add a course from year to year 

It seemed to be the most promising in terms of student learning 

Overall flexibility of course(s) 

The cost of the equi pment 

It was more affordable 

Continuing costs other tha i equipment 

Use of a video-based instructional medium 

It vas the only option available to us 



Yes No 

91 * 9* 

91* 9* 

87* 13* 

83* 17* 

74* 26* 

70* 30* 

65* 35* 

65* 35* 

61* 39* 

57* 43* 

48* 52* 

41* 59* 

22* 73* 



0 
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TABLE 18: Basis for Distance Learning stodeat Enroll meat 



* of Administrators 



Student selection based on thei r grade level 
Students selection based on GPA or perceived ability level 
Student selection based on student motivation level 
No restrictions placed on student enrollment 



5755 
22* 
35* 
70* 



Modification of School Bell Schedule or Calendar 

Nearly two-thirds (65%) of the schools did modify their school 
calendar to accomodate the distance learning class(es), while 6]% 
modified their bell schedule. Similar percentages responded to hov: 
seriously they saw the need for identical class (Ml) schedules and school 
calendars among consortium adopters. 

TABLE 1 9: Imparlance Attributed to Cannes Bell Sc bee-ales and Scheal 
Calendars ba Administrators ia DL Schools 



Administrator Perception of Criteria Considered Necessaru for Successful 
Implementation of a Remote DL Prooram 

Most striking with respect to administrator perceptions about 
criteria needed for successful program implemention is the extent to 
which administrators, lacking any research data, rely on their skepticism 
of state regulations and ease of implementation practices in laying out 
the criteria for successful program implementation. Administrator 
perceptions of such criteria do not necessarily coincide with the criteria 
found in the study to be most related to student success. 

Certainly this demonstrates a need for solid research data to be 
made available to persons in a position of initiating or carrying out 
distance learning programs. For example, 35% of the administrators did 
not see the purchase and implementation of all. intended course 
components to be critical to program success; research data shows, 



* of Administrators 
Common Bell Schedules Common School Calendars 



Must Adopt 
Should Adopt 
Not Sure 

Probably Not Necessary 



35* 
39* 
9* 
17* 



35* 
35* 
13* 

17* 
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however, that elimination of intended course components clearly relates 
to increased student frustration, decreased student motivation, and a 
higher severity level of student-identified problems associated with the 
course. 



TABLE 20: Administrators' Criteria for Successful Program Implementation 

%of Admimatator* 

A course i nstructor certified i n the subject matter taught 
All students enrolled in a live rather than taped course format 
The purchase and implementation of all intended course components 
The capability of continuous live interaction with the instructor 
A supervisor who is available to monitor the class electronically 
The capability of intermittent live interaction with the instructor 
A coordinator or supervisor present in remote classrooms 
stall times 





No 


74% 


26% 


70% 


30% 


65% 


3555 


S7% 


4Z% 


52% 


48% 


48% 


52% 


44% 


56% ' 



Administrator Percention of Role of State Education Agencies in PL 

Administrators were asked whether each of the following activities 
s/tou/d, in their opinion, be carried out by the State Department of Public 
Instruction. The degree to which they "Strongly Agreed", "Agreed", were 
"Undecided", "Disagreed", or "Strongly Agreed" with each potential state 
agency activity was recorded. Activites were ranked according to the 
combined percentage of administrators who "Strongly Agreed" or "Agreed" 
with each activity. 

Of primary interest is the second and third ranked activities. While 
all (1003) of the administrators agreed with the state department's 
traditional role of administering technology grant funds, 92% of the 
administrators believed that state education agencies should provide 
districts with cost and vendor information and collect evaluation 
information from adopting districts for distribution to other districts. 
This is particularly insightful, indicating perceived administrator need 
for and receptivity to technical and research information on distance 
learning technologies. 
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FABLE 21: Mniniatrater Reaction to Potential State Edacatiea Aeeaca. 

Activities 



Administering technology grant funds to applicant 
districts 

Providing technical assistance to school districts 
implementing OL programs 

Setting accreditation standards for OL courses 

Providing school districts vith cost and vendor 
information for courses and technical equipment 

Accrediting providers of national OL courses 

Providing inservice training for DL instructors 

Evaluating OL course content for accreditation purposes 

Collect! ng eval uation i nformation from adopti ng districts 
i n order to share vith other districts 



* of Administrators 
Rank* SA. A U D SJ> 



1 



9 
2 

8 
7 
6 
3 



Establishing standards for supervision of remote students 1 0 

Monitori ng school districts for compliance vith OL 5 
course implementation standards 



7455 2655 

52* 35* 9* 4* — 

35* 3555 17* 9* 4* 

35* 57* 9* — 

30* 44* 22* -- 4* 

27* 50* 14* 9* — 

23* 55* 9* 9* 5* 

22* 70* 4* 4* — 

13* 57* 13* 4* 13* 

9* 73* 5* 9* 5* 



* Rank is based on the combined percentage of administrators responding to "Strongly Agree" 
and "Agree". 
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CLASSROOM COORDINATOR/SUPERVISOR DATA 



Employment Data on CTass room Coordinators/Supervisors 

Persons serving as distance learning coordinators or classroom 
supervisors most often held another position within the school district 
and were not hired specifically to cover the distance learning coordinator 
role. Only 13* of the coordinators were specifically' hired part-time as 
OL classroom supervisors ; 35% were teachers in the school; 9% were 
administrators who also taught; 13% were full-time administrators; and 
30% were staff persons with the school. Staff persons included computer 
lab coordinators, study hall supervisors, teacher aides, and librarians. 



Diagram 4 
Other Positions Held by DL Supervisors 



Otter PttititM 
HtM 



■ TMohir £3.0* 
B T«*oMng Administrator 9.0* 

■ Full-timt Administrator 1 3.0* 
□ Staff Ptrsoo 30.0* 

■ DL Supervisor ooly 13.0* 



Forty-four percent (44%) of the coordinators taught other traditional 
courses in the school for an average of five additional class periods. Two 
teachers (9%) apparently taught 7 other class periods in addition to— or 
more likely, simultaneously with— supervising the distance learning 
class. 
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Diagram 5 
Number of Other Classes Taught 




Diagram 6 
Number of Other Class Periods Taught* 




Only 22% of the OL Supervisors received extra compensation for 
their supervisory duties, while 52% indicated that there were other duties 
which they simultaneously performed during the OL class, e.g., noon-duty 
supervision, substitute teaching, computer lab assistance, study hall 
supervision, library duties, teaching, administrative or "paper" work, 
correcting papers, or preparation for other classes. 
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Seventy-four percent of the OL supervisors just completed their 
first year in the position; 9% had been in the position for mors than 2 
years. 

Knowledge and/or Experience Level of PL Coordinatorr/Suoervisors 

DL Coordinators were asked to rate their own level of knowledge or 
experience with each of the following prior to serving as a DL coordinator 
or supe-'isor. A major finding is that DL Coordinators were, in the 
majority of schools, not selected for any particular experience with or 
knowledge of either the subject matter or equipment utilized. Apart 
from tape recorders, classroom management skills, and VCR's, previous 
experience with computers was highest among DL Coordinators. Slightly 
more than half (59%) of the coordinators of DL courses utilizing 
computers had a moderate or greater knowledge of computers prior to the 
course. Knowledge of course content and modems was least prevalent 
with only \1% and 143 of the applicable coordinators having moderate or 
greater knowledgeof them, respectively. 



TABLE 22: Knevledge/Experience Level of DL Coerdlnators/Supervisers 



1 






% of DL Coordinators — 




X of Applic. 






Very 




Moderate Great 


Not 


Coord, w/ 




N&OSL 


Uttl? 


Some 


Amount 


fiejL Applic, 


Mod.or Greater 
















Experience 


Tape recorders 






1395 


3995 


3595 


1395 


8595 


Classroom management skills 




995 


1395 


2695 


5295 




7895 


YCR's 






2695 


3995 


2695 


995 


7195 


Use of computers 


995 


1795 


495 


3095 


1395 


2695 


5995 


Computer software use 


13% 


1395 


1795 


2295 


1795 


1795 


4795 


Speaker telephones 


17* 


3595 




1795 


495 


2695 


2995 


Satellite receiving equipment 


3096 


1795 


495 


995 


495 


3595 


2095 . 


Knowledge of subject matter 


4895 


2295 


1395 


1395 


495 




1795 


Modems 


3995 




1395 


495 


495 


2995 


1495 



Training of DL Supervisors 

Fifty-two percent (52%) of the Distance Learning Supervisors 
indicated they had received training in that role. Length of training 
ranged from less than 1 hour to 2 days, with an average training length of 
1/2 day. Training was performed by six different entities for the twelve 
supervisors who indicated that they had received training— among them a 
North Dakota State University credit course, a training session by satellite, 
Moyville State University personnel, and the local superintendent. 
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The type of training received is listed in the table below along with 
the percent of coordinators for whom such training would have been 
pertinent based on the particular DL technology in which they were 
involved. 



TABLE 23: Type ef Training Received as OL Coordinate r/Supervlsar 



% RecsivinaTrainina 


* of Coordinators to Whom 
Training Would Have Been 
Pertinent 


Satellite equipment operation 


30* 


43* 


Video equipment operation 


26* 


39* 


Computer operation 


26* 


57* 


Modem operation 


13* 


43* 


Role of the supervisor in the classroom 


30* 


100* 


Other 


4* 





Forty-four percent (44%) indicated that they had received written 
guidelines concerning their OL supervisor role. 

Sources of Technical Assistance 

Coordinators were asked to whom they would turn for assistance if 
technical problems arose in the distance learning course. Although 17% 
listed no source of assistance, 61% of the coordinators indicated one 
source and 23% listed two sources. Among the sources given were the 
satellite course provider (TI-IN or SERC), the course instructor, Prairie 
Public TV, the superintendent or principal, the computer teacher, the 
course facilitator, Mayville State University personnel, or the Department 
of Public Instruction. 

Coordinator Perception of Qualification s Necessary in the Role 

There was nearly universal acceptance of the need for a classroom 
supervisor, at least among the coordinators. The concensus, however, 
stopped there. There was no uniform agreement on whether the role 
should be filled by a teacher, an administrator, or other staff. Seventy 
percent (70%) did feel that the coordinator should be present in the 
classroom at all times and 65% believed the coordinator should have some 
knowledge of the subject matter. 



ERIC 



35 

26 



TABLE 24: Coordinator Perceptions of Qualifications Moceseori in the Role 



Should be a certified teacher in the subject 
matter of the class 

Should be a certified teacher in some subject area 

Should be a certified teacher at the secondary level 

The role can be adequatel g handled by the supeh n- 
tende.it, principal, counselor, or other 
professional employee 

The role can be adequately handled by non- 
professional staff 

Should have some knowledge of the subject matter 
being taught 

Should be present i n the classroom at all ti mes 

There is no need for a classroom facilitator or 
supervisor 

Location of Distance Lea rning Classroom 

More than two-thirds (74%) of the classrooms had been rooms which 
were remodeled or adopted for use as a DL classroom. Thirteen percent 
(13%) of the classes were held In regular classrooms; another 13% were 
held in an office or oiher non-classroom. The remainder were located In a 
library/media center, computer lab, or new room built for l-TV. 

Videotaping of Distance Learning Class 

Fifty-seven percent (57%) of the DL classes are routinely videotaped 
for students who are absent from class, 39% for student review purposes, 
30% for delayed broadcast to students, and 13% for self-critique of 
teacher performance in l-TV classes. 

Other Utilization of Distance Learning Equipment 

According to the classroom coordinators/supervisors, only 13% of 
the schools do not use their DL equipment for other purposes. Among the 
auxiliary uses of the equipment are student enrichment programming 
(30%), community use (48%), business use (9%), sports scheduling among 
schools (13%), administrative discussions/conferences (43%), and teacher 
inservice training (54%). 



% of Coordi nators Agreei ng 
With Statement 
Yes No 
22% 78% 

44% 56% 
48% 52% 
61% 39% 



44% 56% 

65% 35% 

70% 30% 

4% 96% 
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TABLE 25: Auxiliary Uses of Distance Learalae Eqaipawat 



56 of Schools 



Teacher i nservice trai ni ng 

Community uee, e.g., adult education 

School administrator discussions/conferences 

Student enrichment programming 

School sports scheduling among schools 



54* 
4856 
4356 
3056 



Coincidence of Class (Bell) Schedule with PL Broadcast Schedule 

Only 30* of the coordinators reported that their school's class (bell) 
schedule coincided perfectly with the DL class schedule. Among those 
30%, less than half (43%) reported that the bell schedule had been altered 
to accomodate the OL schedule. 

Among the 70% of the schools whose bell schedules did not coincide 
with the DL class schedule, however, 63% of the coordinators reported 
that students are released early or admitted late from other classes in 
order to participate in the entire DL class. In 22% of the schools, 
students missed up to to minutes of the DL class because of overlap with 
other classes. 

Seventy percent (70%) of the coordinators did believe that schools 
participating together in distance learning courses should adopt identical 
bell schedules; 49% believed that non-synchronized school calendars 
among schools participating together in DL courses present a significant 
problem. 

Number of Computers Available to PL Students During Class Time 
Sixty-one percent (61%) of the coordinators reported that a 
computer is not used in their PL classroom. Among the 39% of the classes 
in which computers are used, the following table details the number of 
computers available for students during classtime. 

TABLE 26: Member of Computers Available to DL Stoeeats Derina Class Tiato 



56 of Total Schools 



None 

One 

Two 

Six 



456 
1756 
456 
956 
456 
3956 



Fourteen 
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Duties Perf ormed bu Classroom Coordinators or Supervisors 



• Homework/Test grading 

Sixty-one percent (6 IS) of the coordinators reported that all 
homework and tests are graded by the remote course instructor; 35% 
indicated that grading is shared by the instructor and themselves; 4% 
indicated that the coordinator grades all homework and tests. 

• Student Feedback 

Seventy-four percent (74%) of the coordinators felt that students 
receive feedback from homework and tests quickly enough, while the 
remaining 26% cited problems with delays in remote teacher feedback to 
students. 

• Extent of Coordinator Participation in the DL Course 

Twenty-two percent (22%) of the coordinators reported that they 
are involved in instruction in the DL course, but even among those 22%, 
their instructional role is minimal. Instructional activities in which the 
six coordinators reported participation include bringing in pertinent 
materials to the class, organizing class socials, discussing/reviewing/ 
troubleshooting, running off worksheets and tests, or preparing additional 
worksheets for students. 

Coordinator Perception of Amount Learned bu DL Students 

DL Coordinators were asked to indicate their impression of the 
amount learned by students for each DL class they supervised. They were 
asked to rate each class on a four point scale, using four descriptors— 
"learned a great deal", "learned an acceptable amount", "didn't learn as much 
as I think they should have", "didn't learn much at all". The following table 
shows the coordinators' average rating for all classes within each 
technology as well as for each class within each technology. 

Digital Interactive TV had the highest coordinator rating, with TI-IN 
by Satellite and Analog Interactive TV following closely behind. OSb 
Instruction by Satellite was last in terms of coordinator perception of 
amount learned by students. It should be kept in mind, however, thct 
inadequate implementation of all course components with Instruction by 
Satellite in some schools is probably the major contributing factor to the 
low coordinator rating. 
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TABLE 27: Caartff aatar Rati* tf Aunt LtarMtf oi Stoats 
(it Tecaaalaaf aaa- »i Class) 





A^ereae Coord Rati no 

Ww ^F* ^a^^^F ^aT^F^F ■ ■^^■^l ^ *P 


Average Coord. Rating 


Technoloou 


bu Technoloou 


Qm. 


bu Clew 


Digital l-TY 


3.7 


Art 


4.0 






SDaadvritlno 

^aF BF^F^F^P «F W I 1 faj 


3 8 






Sutnish 1 


3 5 


TI-IN (Sat) 


3.6 


Art 


40 






French 


4.0 






Latin 


40 






Spanish I 


4.0 






Japanese 


2.0 


Analog l-TY 


3.5 


US History 


4.0 






Adv. Biology 


40 






German 1 


3 7 






Spanish 1 


3.5 






Accounting II 


3.0 






Anatomy/Physiology 


3.0 






Child Development 


3 0 


Audiographic 


3.3 


Spanish 1 


3.3 


SERC (Sat.) 


3.2 


Japanese 


3.5 






Russian 1 


3.4 






Probability/Statistics 


3.0 






Micro Economics 


2.5 


OSU (Sat.) 


2.8 


German 1 


3.0 






German II 


2.5 



Coordinator Comparison of Distance Learning vs. Trad itional Courses 

Coordinators were also askegto compare distance learning courses 
utilizing their particular technology with a regular class in the same 
subject. Little concensus existed among coordinators, however, except 
when broken down by technology. Instruction by satellite coordinators 
were much more likely to believe that OL students learn less than they 
would in a traditional class. Both Instruction by Satellite and 
Audiographic Coordinators were much more likely to believe that OL 
students are frustrated by not having a subject-knowledgeable teacher in 
the classroom and that OL students do not want to put forth the effort 
required of them as compared to traditional students. 
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TABLE 28: Ceardl eater Canearlaee ef Dlstaec* Leeralea vfth Traeltfaeel Classes 



Learn less than they would in a regular class 8.7 17.4 17.4 17.4 34.8 4.3 

Are frustrated burnt having a subject- know- 13.0 17.4 13.0 8.7 39.1 8.7 
ledgeable teacher in the classroom 

Do not want to put forth the effort required 8.7 26.1 8.7 17.4 34.8 4.3 



Coordinator attitudes concerning some issues about distance learning 
did not vary as much by technology. Nearly half (48%) of all coordinators 
felt that DL courses give students the opportunity to learn more than they 
may in a traditional class. Audiographic coordinators, however, were 
more likely to display some skepticism about the technology's learning 
potential. The majority of coordinators across all technologies generally 
agreed that distance learning is the only viable alternative for expanding 
their curriculum and that a OL course is preferrable to no course at all. 
Some Instruction by Satellite Coordinators, however, disagreed with the 
preference of a OL course over no course at all, further expressing their 
frustration with the technology as implemented. 

TABLE 29: Csareieater Attitudes Teverd Distance Leeraiee Classes 



Give students the opportunity to learn more 21.7 26.1 30.4 8.7 4.3 8.7 
than they may in a traditional class 

It is the only viable alternate for expand- 30.4 34.8 8.7 13.0 4.3 8.7 
ingour curruculum 



Remote-site DL students oenerallu: 



% of Coordinators 

Strongly Strongly 
Agree Agree Unsure Disagree Disagree NR 



Distance Learning courses: 



% of Coordinators 

Strongly Strongly 
Agree Agree Unsure Disagree Disagree f& 



Is preferrable to no course at all 



69.6 



8.7 



4.3 



8.7 



8.7 
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Coordinator Perception of Whu Students Drooped from Course 

Sixty-five percent (65%) of the coordinators indicated their school's 
policy ailowed students to drop a distance learning course once enrolled. 
Fifty-seven percent (57%) of the coordinators said there were students in 
their classes who tftf drop the course. The coordinators' perceptions of 
why students dropped are detailed in the following table: 

TABLE 30: Coordinator Perception ef Why Steeeats Drooped the OL Ceerse 



% of Total % of Coordinators 

Coordi nators 1 n Agreement Who 

in Agreement Hod Students Drop 

Students felt the course was too difficult 30% 54% 

Students were not motivated to learn 30% 54% 

Students were concerned about grades, e.g., thai r 17% 3 1 % 

GPA or class rank might suffer 

Students vere uncomfortable vith a DL format 17% 3 1 % 

Students felt too much was expected of them 13% 23% 

Students could not quickly get answers to questions 1 3% 23% 

Students felt they were not learni ng 9% 15% 

Students were frustrated by not having a teacher 9% 1 5% 

physically present in the classroom 

Students were frustrated with the technology 4% 8% 

Conflicts with the instructor or coordinator 0% 0% 



Coordinator Assessment of Who Performs Specific Tasks in the DL Class 

Of primary interest is the extent to which the coordinators believed 
that the majority of classroom tasks were being handled by someone. 
Clearly, however, the majority of coordinators did not see most of the 
tasks as their responsibility. With 59% of the coordinators not watching 
or participating in the classes, it is clear that students were being 
expected to "do it on their own". 

TABLE 31 : Coordinator Assessment af Who Performs Specific Tasks ia a DL Class 



Motivates student to do well 
Maintains discipline 
Assists students with computer use 
Assists students with modem or 

electronic mail 
Encourages students to tal k with or 

call the teacher 



Supervisor/ 


Combi- 




Not Applicable/ 


Teacher Coordinator Students nation* 


No one 


NoResoonse 


68% 14% 


— 18% 






32% 41% 


— 27% 






5% 18% 


9% 




68% 


36% 


5% 




59% 


41% 36% 


— 18% 


5% 





(Table continued on next page) 
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Csorci eater Assess owat of Whs ferferiee Specific Testes ie e DL Cless, Coat. 



Supervisor/ Combi- Not Applicable/ 

Teacher Coordinator Students nation* Wo one No Response 

Coordinates use of software to insure 5ft 14ft — — 9ft 73ft 

use of each by all students 
Operates the satellite receiving or 5ft 32ft 5ft 32ft — 27ft 

camera equipment 

TrouWeshoots problems with 9ft 68ft 14ft 5ft 5ft 

equipment 

Administers tests 32ft 64ft — 5ft 

Grades tests 73ft 9ft 5ft 9ft 5ft 

Constructs quizzes or worksheets 77ft — — — 23ft 

w assist student lear ni ng 
identifies and solves problems 55ft 18ft 14ft 14ft 

individual students may be 

having with the course 
Learns the course material along -- 18ft -- 9ft 78ft 

with the students 

Participates or watches all classes — 41ft -- -- 59ft 

along with the students 
Answers simple questions or helps 32ft 36ft 5ft 27ft 

students find answers to problems 



Coordinator Assessment of Improvements Needed in the DL Course^) or 
Technology Involved 

Cixty-three percent (63%) of the coordinators said they felt there 
were aspects of the course or technology which needed improvement. 
Forty-eight percent (43%) felt the probiems were Tolerable", 30% felt 
they were "Serious", and 22% said they were "Severe". 

Problems most frequently cited by the coordinators were technical 
problems (33%) and problems with communication or student feedback 
(30%). Among the three technologies and six originators of DL courses, 
SERC (Satellite) coordinators listed far more problems than did 
coordinators at other sites. Nearly half (48%) of all problems listed were 
at SERC sites. 
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TABLE 32: Problem* Listed b§ DL CeertfiMtere 



Interactive TY 
Analog Digital 



Satellite 
TI-IN QSU SERC 



A olographic 
Telelearnlng 



(* of DL Coord, responding) (6) (4) (2) (3) (5) 



(2) 



Technical problems 
Communication/Student feedback 

problems 
Scheduling problems 
Quality of instruction/Not all 

teachers belong on system 
Clesses should be more elective 
Making up work is hard 
Inservice quality and management 
Keeping students on task 



Percentages Reflect % of AIT Problems Listed 
7* 7% 15% 4* 

26% 4% 



7% 
4% 



4% 



4% 



4% 



4% 



7% 



18* 11* 8* 4% 48% 



4% 

\2% 
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INSTRUCTOR DATA 



Unlike Instruction by Satellite, Interactive Television and 
Audiographic Tele-learning classes originate from within a cluster of 
schools most usually within a geographically proximate area. The number 
of schools (and therefore students) who participate in any one class is 
limited by the ability to interact with the remote teacher via the 
technology. Indeed, to extend the number of schools who participate in 
any one class beyond 4-5 with Interactive TV and 5-7 with Audiographic 
Tele-learning effectively negates the real advantage of the technologies— 
the ability to involve all students interactively with the teacher. 

Twelve teachers— five in Digital l-TV, six in Analog l-TV, and one in 
Audiographic Tele-learning— comprise the teacher cadre involved in 
distance learning courses in North Dakota. Digital l-TV classes taught 
include Advanced English, Art I, Shorthand/Speed Writing, Spanish I, and 
Accounting III. Analog l-TV classes taught are Spanish I, Psychology/US 
History, German I, Anatomy/Physiology, Accounting II, and 
Parenting/Child Development. The Audiographic Tele-learning project 
involves only Spanish I. 

The twelve teachers representing ten districts differ from their 
Instruction by Satellite counterparts in several respects, the most 
obvious of which is their location in and tie to a local school district. 
Instruction by Satellite teachers generally teach to a national audience 
with spontaneous audio-interactive capabilities limited to only a very 
small proportion of the hundreds of students watching the live course. In 
some cases, other capabilities, such as electronic keypad and electronic 
mail attempt to compensate for the lack of immediate student-teacher 
interaction. 

Teaching Experience of PL Instructors 

The majority of DL teachers had extensive prior teaching experience. 
Three-fourths of the teachers had 1 1 or more prior years in the teaching 
profession. Only 1 teacher had 2 years or less experience and two 
teachers had between 3 and 5 years' experience. 

Of the nine teachers with 1 1 or more years' experience, five had 
been in their current district 1 1 or more years; three had been employed 
in the current district for 6-10 years. 
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Teaching Schedule 

Nine of the twelve teachers (75%) were full-time teachers in their 
home district with either a six- or seven-hour teaching load including 
prep hour. One OL class was taught by a superintendent who also taught 
two hours per day and one was taught by a teacher holding a part-time 
position with the district. 

Time Allotments 

Time devoted to preparation and teaching of the distance learning 
classes can be seen in the table below. Of significance is that three- 
fourths (75%) of the DL teachers spent three or more days prior to the 
beginning of the school year preparing for the DL class. Fifty percent 
(50%) of the DL teachers devoted six or more hours per week during the 
school day to the DL class and one third (33%) spent six or more hours per 
week after school hours on DL class preparation. Clearly, involvement in 
the DL class exacted a tini9 toll— at least for the first year— on those 
teachers involved. 



TABLE 33: Distance Learning Teacher Preparation Time 







*of DL Instructors- 


Amount of Time 


Prior to the beginning 




Devoted to DL Class 


of the school user 


Durira the school dau 


Odays 


25.0?? 




3 da ye 


16.7* 




6 days 


8.3* 




10 days 


25.0* 




14days 


16.7* 




15 days 


9,3* 






100* 




Less than 2 hrs/vk 




8.3* 


2-5 hrs/vk 




41.7* 


6- 1 0 hrs/vk 




33.3* 


More than 1 0 hrs/vk 




16.7* 






100* 



After school hours 



33.3* 
33.3* 
25.0* 
8.3* 
100* 



Teachers were evenly split with respect to the point at which 
they became involved in the distance learning class. Half became involved 
in the early planning stages of the project; half became involved later as 
instructors were being identified. 
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S ources of Technical Assistance for PL Teachers 

Half of the OL teachers (50%) indicated they could turn to a single 
source for assistance if /when technical problems arose. In the case of 
the Interactive TV teachers, that source was either the telephone 
company, the technical consultant hired by the consortium or a local 
administrator. The instructor in the Audiographic Tele-learning project 
felt he could turn to the author of the computer program being used in the 
technology. Two additional instructors felt there were two sources of 
assistance upon which he/she could rely— the telephone company plus the 
technical consultant or local administrator. One-fourth of the instructors 
did not indicate a source of assistance available to them. 

Problems Identified 

Three-fourths (75%) of the teachers indicated ttiat there had been 
problems that occurred early in the course but that they had now been 
resolved for the most part. The remaining one-fourth (25%)— 2 Analog I- 
TV and 1 Digital l-TV teachers— indicated no technical problems had 
arisen during the course. 

Teacher Knowledge or Experience with Various Technologies 

Teachers were asked to rate their own knowledge of or experience 
with each of several technologies prior to becoming involved with the DL 
course. Their responses are detailed in the table below. Of particular 
interest is the relative technological inexperience of the OL teachers. One 
third had used computers very little or not at all. Half or more had never 
used modems, satellite receiving equipment, speaker telephones, or fax 
machines. Indeed, VCR's and tape recorders were the only two pieces of 
equipment listed which had been widely used, i.e., a "moderate amount" or 
a "great deal". 

TABLE 34: Level of Technological Knowledge or Experience of DL Teachers 





None 


Yeru Little 


Some 


Moderate 
Amount 


Great Deal 


TOTAL 


Use of computers 


8* 


25* 




42* 


25* 


100* 


Modems 


58* 


17* 




17* 


8* 


100* 


VCR's 








67* 


33* 


100* 


Satellite receiving equipment 


67% 


8* 


17* 




8* 


100* 


Computer software use 


8* 


17* 


8* 


42* 


25* 


100* 


Tape recorders 


17* 






42* 


42* 


100* 


Speaker telephones 


50* 


25* 


25* 






100* 


Yideocameras 


17* 




42* 


33* 


8* 


100* 


Fax machines 


58* 


25* 




17* 




100* 
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DL instructors were rated on their "technological expertise" by 
calculating their composite score for knowledge of the nine pieces of 
technical equipment. The scale range was 0 to 36 with 0 signifying no 
knowledge of any of the equipment and 36 signifying a "great deal" of 
knowledge of or experience with each piece of equipment. Actual 
composite scores ranged from 5 to 29 and average technological 
experience scores ranged from .6 to 3.2. As can be seen in the following 
graph, the amount of technological knowedge or experience was minimal 
among the bulk of the DL instructors with 8 of the 12 instructors scoring 
an average of 2.0 or less. 
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0 
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DIAGRAM 7: Tech t»l o^g Experience "Scores" of Individual DL Instructors 



Distance Learning Instructor Training 

All DL instructors received training through either a Valley City 
State University (North Dakota) course, a teacher from the Battle Lake, 
Minnesota Interactive TV Project, the local telephone company, or the 
Pennsylvania developers of the Audiographic Tele-learning system. 

The amount of training received ranged from 6 to 35 hours with 
Analog l-TV instructors all receiving 18 or more hours training and 
Digital l-TV instructors all receiving between 6-14 hours training. The 
Audiographic Tele-learning instructor reported having received 10 hours 
of training. 
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As can be seen in the table below, both Analog and Digitial l-TV 
instructors received training in equipment operation and practice teaching 
using the technology, however the Audiographic instructor received 
training in only the computer software used. In addition three Digital I- 
TV instructors mentioned other training received, e.g., use of suitable 
visuals, proper teaching techniques, and classroom organization. 

TABLE 35: Type of Troiaiaa Receive* by DL I Retractors 

% of PL Instructors Rec eiving Training 

Analog l-TY Digital l-TV Audtoor.Tele-learnino 

Equipment operation 10055 100* 0% 

Computer software used NA* NA* 100% 

Organizing the curriculum 17% 20% o% 

Practice teaching using the 100% 80% 0% 
technology 
Other: 

Use of suitable visuals 20% 

Proper teaching techniques 20% 

Classroom organization 20% 



* Not applicable to that technology 



Comparison of Tradition al vs. DL Teaching Roles 

DL instructors were asked to describe the difference between their 
role as a teacher in the distance learning class and their role as a teacher 
in a regular classroom. Three-fourths (75%) of the DL instructors saw 
little difference in carrying out the two roles, but half (50%) felt that 
teaching is more exciting in a distance learning class and two-thirds 
(67%) felt they could teach "better" utilizing the educational technology. 
All (100%) disagreed that discipline is more of a problem in a DL class. 

Two-thirds of the DL instructors did believe that there is less 
student-teacher interaction in a DL class and that it is more difficult to 
know if their students in a DL class understand what they are teaching. 
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TABLE 36: DL Instructor Comparison of Traditions' 
VS. DL Teochina Roles 

%of DL Instructors in 
Agreement vlth Statement 



There is little difference between the tvo roles 75% 

Each requi res a different teachi ng style 67% 

It is more difficult to know if your students in a distance 67% 

learning class understand what you are teaching 

There is less interaction between teacher and students in a 67% 

distance learning class 

Discipline is more of a problem in a distance learning class Q% 

Teachi ng is more reward! ng i n a distance lear ni ng class 25% 

Teaching is more exciting in a distance learning class 50% 

I feel I can teach "better" utilizi ng the educational 67% 

technology in the distance learning class 



Use of a Written Curriculum 

Three-fourths (75%) of the DL instructors indicated that they use a 
written curriculum with learning objectives in both their traditional and 
DL classes. 

Essential Attributes of DL Instructors 

Each DL instructor was asked to identify, in their opinion, the 
essential attributes of a distance learning instructor. All 000%) agreed 
that flexibity, organizational skills, and an outgoing personality are 
needed, while less than half (42%) felt that an expertise in the technology 
was essential. 

TABLE 37: Essential Attributes of DL Instructors 

% of DL Instructors Identifui no Attribute 



Flexibility 100% 

Organizational skills 1 00% 

An outgoi ng personality 1 00% 

An exceptional command of the subject matter 75% 

Expertise i n technology 42% 
Other: 

Exceptional writing and speaking skills 8% 

Willingness to work more 8% 
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PL vs. Traditional Curriculum 

Most North Dakota OL instructors (75%) indicated that the 
curriculum followed in the DL course did not differ from that of a 
traditional class in tne same subject matter; one fourtn believed they 
cover less material and that the material is covered more slowly in a DL 
class. From the DL instructor's point of view, the Audiographic Tele- 
learning class only differed from a traditions; curriculum in terms of 
greater reliance on the textbook, while differences among Interactive TV 
classes appeared to be much more dependent upon the individual teacher. 



TABLE 38: DL Instructor Comparison of DL vs. Traditional Corneal an 



* of DL Instructors In Agreement 







with Statement 






Analog 


Digital 


Audiogr. 










Tele. 


Total 


The curriculum does not differ; 1 cover 


83* 


60* 


100* 


75% 


essentially the seme material at the same pace 










1 relg more on the textbook in the OL class 


i7* 


0* 


100* 


17* 


1 use more worksheets in my OL class 


0* 


20* 


0* 


8* 


1 use more tests and/or quizzes in my OL cless 


17* 


0* 


0* 


8* 


1 seem to cover material more slowly In the OL class 


17* 


40* 


0* 


25* 


1 seem to cover less material in the OL class 


17* 


40* 


0* 


25* 


1 can expose students to a wider array of i nformation 


83* 


40* 


0* 


58* 



through the use of technology 



Methods of Homework and Test Transmission in DL Classes 

Several methods of homework and test transmission were utilized in 
the DL classes, including mail, FAX, courier, videocamera, and computer. 
While the methods employed were many, most notable was the 
combination of methods most districts used to transmit tests, quizzes, 
worksheets, notes, and homework assignments both to and from the 
students. 



TABLE 39: Methods of Transmission of Homework ami Tests 



p * of Sites Using Each Method of Transmission — i 
Mail FAX. Videocam Courier Computer 

Tests/quizzes sent to remote students 10 10 2 3 0 

Worksheets/notes sent to remote students 9 7 2 3 1 

Tests/quizzes returned to instructor 11 1 0 3 0 

Homework assignments returned to instructor 12 1 2 4 0 
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Turnaround time with respect to transmission of tests and 
homework was a concern expressed by one-fourth of the DL instructors. 
Only two Digital and one Analog l-TV instructor said they were not 
satisfied with the turnaround time. Turnaround time was reported to 
range from 2-3 days to more than eight days, with 64% of the l-TV 
instructors indicating a usual 2-3 day turnaround time. 

DL Instructo r Contact with Students Outside of Class Time 

Seven of the twelve DL instructors (58%) indicated that provisions 
are made for students to reach them outside class time. Frequency of 
student contact outside class time is detailed in the table below. 



TABLE 40: Freqacaca of Oat-of-Claas Contact Betveoa 
DL Stadents an* Teachers 

% of I instructors . 

Once/ 2-3 Times Once/ 2-3 Times More 

Never Rarelu Month Month Week Week Often Total 

50% 33% — 8% 8% — — 100% 

58%* 25% — 8% — 8% — 100% 

92%** 8% 100% 

83% 17% — — -- -- — 100% 

67% 25% 8% — -- -- — 100% 



By telephone 
Over the Interactive 

TY network 
Over the Audiographic 

system 
By electronic mail 
By regular mail 



* Not available to Audiographic Tele-learning schools 
** Not available to I nterective TY schools 



Analog l-TV instructors were much more likely to have some contact 
with their students outside of class time than were Digital l-TV 
instructors, although frequency of contacts was not great in either case. 
The Audiographic instructor indicated out-of-class contact between the 
students and himself occurred rarely; methods of contact were by 
telephone, over the Audiographic system, and by regular mail. 
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TABLE 41 : Incidence tf Q«t-ef-C1a*s» St«dCBt-Tmel»r Contact 

•« TccbMltf 9 



% of DL Instructors Indicating Any Out of Class Cortact 
vith Students bu Tachnoloou Adopted 



By telephone 

Over the l-TY network 

Over the Audlographic system 

By electronic mail 

By regular mail 



Woital l-TV 
20% 
20% 



Analog l-TV 
67% 
67% 



Audtoor.Tel. 
100%* 



0% 
20% 



33% 
33% 



100%* 
0% 
100%* 



* Based on the single Audlographic Tele-learning Instructor's responses 



Instructors' Opinions of Qualifications Necessary for * Supervisor in 
a Distance Learning Classroom 

Supervision of remote classrooms Is a topic of continuing debate. In 
the opinion of the DL instructors of Interactive TV and Audlographic Tele- 
learning, three-fourths believed that the supervisor role could be 
adequately handled by either a professional employee, e.g., superintendent, 
principal, counselor, etc., or by a non-professional employee, e.g., 
secretary, aide, etc. More than half (58%), however, felt electronic 
supervision of the students was sufficient, while one-third (33%) felt 
there was no need for a classroom supervisor as they could adequately 
oversee students themselves. 

Among Digital l-TV instructors, 60% felt the supervisor should be 
present in the classroom at all times, while all Analog instructors (100%) 
saw no reason for a supervisor to be continually present, indicating that 
electronic supervision was sufficient. More importantly, two-thirds of 
all Analog instructors (67%) saw no need for a classroom supervisor at 
all, while all Digital instructors (100%) did see a need for classroom 
supervision of some type. Thus further lends support to the 
inapproprlateness of uniform state regulations for supervision of DL 
courses, given the broad range of technologies and student-teacher audio- 
visual contact. 
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TABLE 42: I infractors' Optalooo tf Qeollflcotloos Hocmiri 
for Supervisors of Distaec* Looroiof Cloooroom 

* of OL Instructors In Agree- 
ment with Statement 



The supervisor should be a certified teacher i n the subject 8* 
matter of the class 

The supervisor should be a certified teacher i n some subject area 3355 
The supervisor should be a certified teacher at the secondary level 1 7* 

The supervisor role can be adequate! y handled by the superi ntendent 75* 

principal , counselor, or other professional employee 
The supervisor role can be adequately handled by non- professional 75* 

staff, e.g., a secretary or a part-time community person hired 

for the job 

The supervisor should neve some knowledge of the subject 1 7* 

matter being taught 

The supervisor should be present i n the classroom at all ti mes 33* 
Electronic supervision of the students ( by TY monitor) is sufficient 58* 
There is no need for a classroom supervisor ; I can adequatel y 33* 
oversee all students 



Videotaping of PL Classes 

Half of all Interactive TV instructors routinely videotape their 
classes. Fifty-five percent (55%) videotaped the class for students who 
cannot view the class live or who are absent from class; 18% videotaped 
the class for student review purposes; 45% videotaped the class as a way 
of evaluating their teaching or for their personal library. 

PL Instructor Opinion of Synchronized Bell Schedules and School Calendars 
All PL instructors believed that participating districts should adopt 
identical class (bell) schedules, while three-fourths (75%) believed that 
non-synchronized school calendars present a significant problem to 
schools participating together in PL courses. 

Student Attrition in PL Courses 

Seven of the twelve PL instructors (58%) indicated that there were 
students who had dropped the course during the year. Five of the six 
Analog I -TV schools (83%) had had students who dropped the course, 
compared to one of five Pigital l-TV schools (20%). It should be kept in 
mind, however, that the Pigital l-TV project had been in operation for only 
the second semester. Reasons cited by the PL instructors for student 
attrition is reflected in the table below: 
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TABLE 43: ReiMM For Stvtftat Attrition in OL Coarse* as Indicated 

•9 OL Instructors 

% of DL Instructors Giving Reason 
for Students Droooino PL Course 

Digital I -TV* Analog I -TV Audioor.Tcl.** 



Students felt the course vas too difficult 


0% 


17% 


100% 


Students were not motivated to learn 


0% 


17% 


100% 


Students felt too much vas expected of them 


0% 


83% 


100% 


Conflicts with the instructor or supervisor 


0% 


0% 


0% 


Students vere uncomfortable with a distance 


0% 


83% 


100% 


learning format 








Students felt they vere not learning 


0% 


0% 


100% 


Students vere frustrated vith the technology 


0% 


0% 


100% 


Students vere concerned about grades, e.g., 


0% 


0% 


100% 


their GPA or class rank might suffer 








Students vere frustrated bg not having a teacher 


0% 


0% 


0% 


physically present in the classroom 








Students could not quickly get ansvors to questions 


0% 


0% 


0% 


Got too far behind because of illness 


20% 






Unusually long absences 




17% 




Job release 




17% 




Transferred to another school 




17% 




Didn't need the course 




17% 





* The Digital I -TV classes had been 1 n operation for onl y one semester at the ti me of study. 
** The Audiographic Tele-learning responses are based on information provided by one instructor 

Of must interest is the five of six Analog l-TV instructors who 
indicated that some students had dropped the DL course because they felt 
that too much was expected of them or that they were uncomfortable with 
the DL format. Also of interest are the 17% of Analog schools who 
reported non-course related reasons for dropping out, e.g., lengthy 
absences, job release, school transfer, etc. As the Digital l-TV program 
was in operation for only one semester, student attrition was not e 
factor. None of the l-TV instructors indicated conflicts with the 
instructor or supervisor, student frustration with not having a teacher in 
the classroom, or inability to get questions answered quickly as reasons 
for student attrition in the DL courses. 

Actual numbers of students dropping the DL courses were not in 
excess of what would be expected within traditional courses. 



Instructor Opinion of Amount Learned bu PL Students 

Instructors were asked to assess the amount learned by their 
respective OL students during the year. Forty-two percent (42%) 
indicated their students had learned a great deal; 50% felt their students 
had learned an acceptable amount; only 1 instructor (8%) indicated that 
the students had not learned as much as she thought they should have. The 
breakdown by technology is shown in the table below: 

TABLE 44: Instructor Qpiaiaa ifAMitt Learaea* aa OL Stafcats 

Tecaaalaff 

% of DL Instructors Indicating 

Amount Learned bu Students 

Digital 1-TY Analog I -TV Audioor.Tel. 
A great deal 20% 50% 50%* 

An acceptable amount 60% 50% 50%* 

Not as much as i think they should have by now 2056 
Mot much at all zz. — 

100% 100% 100% 



The Audiographic Tele-learning instructor indicated that the better students learned a 
great deal while the average students learned an acceptable amount. 



instructor Comparison of DL Classes with Traditional Classes 

Instructor attitudes regarding DL classes in comparison with 
traditional classes seem to indicate universal support for the respective 
DL technologies employed. All are also in agreement that the DL course is 
preferrable to no course at all, even though only 25% of the instructors 
believed that distance learning is the only alternative available fcr 
expanding the curriculum. 
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TABLE 45 : Instructor Caaparlaaa af OL Classes 
With Tratfitiaaal Cli 



i DL Instructor Opinions j 

Strongly Strongiy 1 

JarSL. Agree Undecided Disagree Disagree NR 

Remote Site DL students ocneraUu: 

Learn less than theyvould in a regular clsss -- — 25% 2S% 42% 8% 

Are frustrated by not having a subject- -- -- 25% \7% 50% 8% 

knowledgeable teacher in the classroom 

Do net want to put forth the effort required -- -- 17% 58% 17% 8% 

Distance Learning Courses: 

Give students the opportunity to learn more 8% 8% 25% -- 50% 8% 
•han they may in * traditional class 

Is the only viable alternative available for 25% -- 33% 8% 25% 8% 
expanding our curriculum 

is prefer rabie to no course at all 67% 25% -- -- -- 8% 



When looking at Digital and Analog I-TV instructor attitudes, we see 
a slightly more positive attitude exhibited among Analog instructors. As 
compared to only 60% of Digital Instructors, all Analog instructors (100S) 
disagreed that DL students learn less, that they are frustrated by not 
having a subject-knowledgeable teacher in the classroom, and that DL 
students do not want to put forth the effort required of them. 

Instructor Assessment of Who Performs Tasks Associated with Teaching 
in a DL Classroom 

Instructors were given a list of tasks which might be the 
responsibility of the teacher in a traditional classroom. They were asked 
who, if anyone, performed those tasks in their distance learning class. 

Perhaps of most interest is the role which the instructors see the 
classroom coordinators playing. They depict a coordinator who basicly 
oversees tests, who does not identify or solve individual student problems 
or answer simple questions for students, indeed who, in three-fourths of 
the schools, does not learn the course material along with the students or 
even watch all classes with the students. Even maintenance of discipline 
at the remote sites is seen by half of the instructors as being their own 
responsibility. 
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TABLE 46: instructor Assessment of Who Performs Specific Tasks 

in a OL Class 







Supervisor/ 




Combl- 




Not Applicable/ 




Teacher Coordinator Students nation* 


No one 


No Response 


Motivates student to do veil 


33% 


8% 





8% 


— — 


- - 


rial mains discipline 


50% 


8% 


8% 


33% 




— — 


Assists students vith computer use 


17* 


17% 


- — 


8% 


8% 


50% 


Assists students vith modem or 


— 


17% 


- - 




25% 


58% 


electronic mail 














Encourages students to tal k vith or 


3355 


33% 


— m» 


17% 


17% 


- - 


call the teacher 














Assists students vith software use 


25% 


8% 








67% 


Operates the equipment at a remote 


— — 


17% 


50% 


33% 






site 














Troubleshoots problems vith 


8% 


25% 


8% 


58% 







equipment 














Administers tests 


8% 


67% 


— — 


25% 


— — 


- — 


Grades tests 


100% 












Constructs quizzes or worksheets 


100% 












to assist student learning 














1 n.ii mm mm — — -M m m!%m - — m t_ m m~ ti 1 » rei ■ 

laenuTies ana solves prooiems 


75% 






25% 






individual students may be 














having vith the course 














Learns the course material along 




25% 






75% 




vith the students 














Participates or vetches all classes 




25% 






67% 




along vith the students 














Answers simple questions or helps 


42% 






50% 


8% 





students find ansvers to problems 



Instructor Opinions of Problems Fncou ntered with the PL rrnurse 

Two-thirds (67*) of the DL Instructors believed there were aspects 
of the course or technology on which Improvement was needed. No 
difference existed In this opinion with respect to technology 
implemented. Three of five Digital l-TV Instructors and four nf six 
Analog l-TV Instructors, as well as the Audlographlc Tele-learning 
Instructor, felt that Improvements were needed. Problems listed by 
Instructors along with their severity can be seen In the table below: 
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TABLE 47: Problems Identified by OL Instructors 



Problems Listed bu Instructors Digital I -TV Analog 1-TV Audioor.Tel. 

Microphones must be passed around for teacher X 

to be able to hear students (Unspecified*) 
Students in remote sites cannot converse in X 

language while seei ng each other ( Unspecified*) 
My small screen monitor is hard to disti nguish lip X 

sounds or pronunciation (Unspecified*) 
There is no control over remote cameras (Tolerable) X 
Student screening needs to be improved — some X 

students who lack responsibility or independence 

will not do as veil, no matter how well they're 

supervised at the remote site (Serious) 
Teachers need to have a greater role i n planni ng X 

course offerings and running the system- -it 

shouldn't be just an administrative decision 

(Serious) 

Students cannot ask questions if camera is locked i n X 
on another school (Severe) 

A little more advanced communication is needed X 
(Unspecified) 

Audio could be cleaner (Tolerable) X 
More microphones are needed (Tolerable) X 
Sound- -it is better than tolerable, but always could X 

beimproved upon (Tolerable) 
We need to meet with the whole class early in the X 

school year (Tolerable) 

Telephone li ne needs to be i mproved — data is missed X 
on the computer (Serious) 



* "Unspecified" refers to problems on which instructors did not specify the severity of the 
problem mentioned. 



Judging from the problems and severity specified, the Analog l-TV 
instructors were most satisfied with how their technology and course 
operated. Technically, the Analog l-TV instructors found only minor fault 
with the audio, indicating that the sound could be cleaner and that more 
microphones were needed. 

Of greatest severity was the technical problem mentioned by Digital 
l-TV instructors concerning the inability for students to converse, ask or 
respond to questions when the camera is locked on another school. This 
perceived problem stems from the lack of continuous multi-site audio and 
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video, as only one site can be seen or heard at one time. Unlike Digital I- 
TV, Analog l-TV does offer the capability for all sites to be 
simultaneously seen and heard. 

The Audiographic instructor also found serious fault with the 
quality of phone lines resulting in poor data and voice transmission 
between computer sites. 

Instructor Ooinion of the Future of Their PL Technoloou 

All North Dakota Distance Learning instructors felt that the 
widespread use of their particular technology would grow whether or not 
the remaining problems with the technology are resolved. None felt that 
other DL technologies would likely take its place and only one instructor 
felt that there will cease to be a need for distance learning. 

Written comments offered by the instructors show substantial 
support for their involvement in the DL program. Excerpts are included 
below: 

Tor the most part, my I -TY experience has been challenging and 
rewarding. I look forward to teaching on the system again." (Analog) 

"I feel l-TY is an excellent alternative to small rural schoolr. Used to its 
full potential, classes never feasable vill now be easily accessable to the 
rural high school student." (Digital) 

"I have loved teaching on l-TY and I would teach more I -TV classes. The 
'earning success is the same as the traditional classroom- -the techniques 
are easier. . . We had more problems with coordinating schedules and 
administrative policies among schools than really technical problems," 
(Analog) 

"I am anxious to continue l-TV teaching and I am very satisfied with the 
technology itself. I am confident that it is an effective teaching tool. I am 
concerned, however, that in some cases it may be viewed as an approach 
to basic curriculum on many levels. If we are truly concerned with 
quality and enhanced learning, we need to realize that it is not for everu 
student, nor Is it for everu teacher." ( Digital ) 
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SIGNIFICANT CROSS-TECHNOLOGY COMPARISONS 



Amount of Student -Teacher Interaction 

Student-teacher interaction was significantly greater in 
Audiographic and Interactive TV classes with 100% and 91% of the 
students respectively reporting some interaction, as compared to 62% of 
Instruction by Satellite students. Frequency of interaction was highest in 
Audiographic classes with 86* of the students reporting interaction more 
often than three times per week, compared to 58% of I -TV students and 
\% of Instruction by Satellite students. 

TABLE 48: Frequency of Student-Teacher Interaction During 
Class Time bu Technology 





1 

Never Rarelu 


Once/ 2 
Month 


n vi aim* 

-3 Times 
Month 


Once/ 
Week 


2-3 Times 
Week 


More 
Often 


1 

Total 


Interactive TV 

Analog 


9* 

10* 


8* 

8* 


1* 

2* 


2% 

2* 


6* 

6* 


16* 

20* 


58* 

53* 

• 


100* 

100* 


Digital 


6* 


8* 




4* 


4* 


8* 


69* 


100* 


Instruction by 
Satellite 

TI-IN 


38* 


20% 

12* 


14* 

12* 


11* 

38* 


4* 

38* 


13* 


1* 


100* 

100* 


OSU 


85* 


12* 










3* 


100* 


SERC 


5* 


28* 


26* 


16* 




26* 




100* 


Audiographic 
Tele-learning 










7* 


7* 


86* 


100* 



Within techologies, frequency of interaction is slightly higher in 
Digital l-TV classrooms as compared to Analog classrooms, although 
spontaneity of interaction is clearly facilitated to a greater extent with 
the Analog techology and it is suspected, although not directly addressed 
in the study, that more interactions occur per class period with that 
technology. 

Comparison of PL with Traditional Courses 

The comparison of distance learning with traditional courses was 
the focus of several questions answered by ooth classroom coordinators 
and remote Audiographic and l-TV instructors. Respondents were asked 
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whether they agreed or disagreed with a series of six statements 
concerning OL students and courses. 
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TABLE 49: Coordinator on* Instructor Comparison of Distance Learning vlth 

Troditiouel Students: 
Aunt Loomed & Student Frustration 

l * Of Coordinators (Instructors) 1 



Statement 



Remote site OL stedeats 
learn |qjj 



Interactive TV 

Analog 

Digital 

I astr action be, 
Satellite 

TI-IN 

osu 

SERC 

Audiegroauic 
Tele- leer aing 



Agree or 

Strongly 

Agree 



11* 

20* 
SO* 

50* 
6?% 
40* 



Remote site DL students 
ere frustrated 09 aet 
having 0 eabject kaevledoe- 
oble teacher in the classroom 



Tele-learning 



Undecided 



11* 



20* (40*) 
20* 



40* 

33* (100*) 



Disagree or 

Strongly 

Disagree 



78* 

100* (100*) 
60* (60*) 
30* 
50* 
33* 
20* 
67* 



Interactive TV 


13* 


13* 


Analog 






Digital 


25* 


25* (20*) 


laatractiaa bg 


40* 


20* 


Satellite 






TI-IN 


50* 




OSU 


33* 


33* 


SERC 


40* 


20* 


Audiegreahic 


67* 
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75* 

100* (100*) 
50* (60*) 
40* 
50* 
33* 
40* 

33* (100*) 



Instruction by Satellite coordinators were much more likely to 
believe that remote site OL students generally learn less than they would 
in a regular class. Audiographic coordinators were more likely to believe 
that DL students are frustrated by not having a subject-knowledgeable 
teacher in the classroom and that DL students do not want to put forth the 
effort required of them. 

The majority of both l-TV and Instruction by Satellite coordinators 
believed that DL courses give students the opportunity to learn more than 
they may in a traditional class. 

OSU Instruction by Satellite coordinators were unique in 
questionning whether DL courses are the only viable alternative for 
expanding the curriculum or whether they are preferrable to no courses at 
all. 



TABLE 50: Coordinator and Instructor Co«*a risen of Distance Learning vith 
Traditional Students: Student Effort Required 



Statement 



Remote site DL students da 
net vaat te put forth the 
effort required 



I 

Agree or 

Strongly 

Agree 



-* Of Coordinators (Instructors) 



Interactive TV 

Analog 

Digital 

Instruction bg 
Satellite 

TI-IN 

OSU 

SERC 

Audioqraphic 
Tele-learning 



22% 

40% 
40% 

33* 

67* 



Undecided 



11* 

20* (40*) 

10* 

50* 



Disagree or 

Strongly 

Disagree 



67* 

100* (100*) 
40* (60*) 
50* 
50* 
67* 
40* 

33% (100%) 
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TABLE 51 : Coertfleater a Ml Instructor Cewaarlsea ef Distance Leeralae vlth 
Traditional Cearses: Leeraiee Opeertealtg 

Statement 



Distance laaraiaf csarsas 
give steeeats tat eaaartaaita 
ta leara awre. . . 


Agree or 
Strongly 
Agree 


Undecided 


Disagree or 

Strongly 

Disaoree 


later active TV 

Analog 


63% 

50% (2055) 


37% 

50% 




Digital 


75% (20%) 


25% (40%) 


-- (40%) 


lastractlaa ba 
Satellite 

TI-IN 


SOX 

50% 


40% 

50% 


10% 


OSU 


67% 




33% 


SERC 


40% 


60% 




'Aeeiearephic 
Tele-learniaf 


33% 


-- (100%) 


67% 


TABLE 52: Ceardiaatar aaal laatracter Caaiaansaa af Diataace Learaiea 
vita Traaitiaaal Cearses: Oala viable Alter native 


Statement r 


% Of Coordinators (Instructors) . 


Distance laaraiaf cearses 
ire the sale viable alternative 
fer corneal am expaesiea 


Agree or 
Strongly 
Aoree 


Undecided 


Disagree or 
Strongly 
Disaoree 


Interactive TV 


63% 


25% 


15% 


Analog 


50% (60%) 


50% 


— (40%) 


Digital 


75% (60%) 




25% (40%) 


lastractiea by 
Satellite 

TI-IN 


70% 

100% 




30% 


OSU 


33% 




67% 


SERC 


80% 




20% 


Aeaioarepaic 
Tele-leerainf 


100% 


— (100%) 
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TABLE 53: Caartff aatar aai lastractar Caaaarlaaa af Dlstaaca Lear ate* vita 
Tnti tiaaal Caarsaa: Preferable ta Ha Caaraa 



TSistaaca laaraiaf ceari 
art preferraale ta aa caaraa 
at all 



r 



lattractlvt TY 

Analog 

Digital 

laatroctlaa eg 
Satallfta 

TI-IN 

OSU 

SERC 

Aartiagraaaic 
Tale-learniag 



% Of Coordinators (Instructors) 



Agree or 
Strongly 
Agree 



100% 

100% (100%) 
100% (100%) 
70% 
100% 

80% 
100% (100%) 



Undecided 



10% 



33% 



Disagree or 

Strongly 

Disagree 



20% 

33% 
20% 



Costs of Distan ce Learning 

In North Dakota, as elsewhere, distance learning costs vary 
tremendously not only by technology but within each technology. While 
Instruction by Satellite had the lowest average implementation cost of 
the three major technology types at just under $20,000 per school, three 
factors bear mentioning: (1) Depending upon the source of Instruction by 
Satellite, average costs ranged from $13,000 to $32,000; (2) incomplete 
implementation of OSU's Instruction by Satellite classes by some schools 
may hove affected the lower dollar implementation costs; and (3) the 
average SERC cost of $20,558 in North Dakota did not include the $35,000 
state membership fee, making that particular program much more 
expensive than it appears. 

The Analog Interactive TV technology was the most expensive to 
implement, by far, but the costs of equipment and fiber optic line 
purchase or lease was highly variable, depending both upon a given 
school's existing access to fiber optic capabilities and the pricing 
policies of the telephone company with whom the school must deal. The 
average cost of Digital Interactive TV systems in North Dakota was 
approximately half that of the Analog systems, but the capability for 
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spontaneous student-teacher interaction also differed, again raising the 
issue of the value of student-teacher interaction. 

The Audiographic Tele-learning projects averaged just over $23,000 
in terms of implementation costs, making the technology more expensive 
than Instruction by Satellite though less than interactive TV. The annual 
costs of continuing Audiographic classes, however, was far less than that 
of the other two technologies, but the purposes for which it is used may 
be more restricted. Teacher in-service training, for instance, would be 
very difficult to carry out via this technology. 

Issues of cost are extremely difficult to compare with respect to 
distance learning, not only as they relate to student performance but also 
because of the variability with which they are implemented across 
adopting school districts. Incomplete or inadequate implementation, e.g., 
excluding one or more intended course components, is a particular 
problem in trying to equate Instruction by Satellite costs with those of 
other technologies. Some technology costs involve incremental increases 
with each course offered; others bear a standard fee with access to any or 
all courses offered. Some costs include auxiliary services, e.g., teacher in- 
service programming, at a set fee; some include a portion of the 
programming at no extra charge, while charging additionally for other 
programs viewed; others charge separately for each program viewed. 

in summary, it appears that there is no simple nor conclusive 
answer to the question: Which technology provides the best education at 
the lowest cost? It is equally clear that adopters must look at the costs 
incurred with each technology as they apply to their own situation. Given 
the technological naivete of most school administrators, it is imperative 
that they enter into the distance learning arena prepared to evaluate each 
technology according to their own identified needs, financial contraints, 
and existing capabilities. It is equally imperative that they realize there 
is no "package deal"— one cannot "purchase" Instruction by Satellite or 
Interactive TV or Audiographic Tele-learning as one would buy a new 
textbook. There are multiple components and variable equipment pieces 
connected not only with each technology, but with each provider of 
distance learning courseware. Third-party vendors differ considerably 
with respect to the costs of similar equipment and equalivalent quality 
cannot always be readily verified. 

Distance learning adopters are clearly in need of a source of 
technological expertise and implementation assistance apart from the 
commercial DL providers or equipment vendors. This should be a major 
focus of state education agencies as we prepare for the 21st century. 
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TABLE 54 

DISTANCE LEARMN6 COSTS IN NORTH DAKOTA 



piwn North i J ii k i) t ti U i t <un: t? I t;nr ri i rn| 



Technology 



Implementing Coete 



Est. Annuel Costs 



.(* of Schools on Which 
Coot Doto is (wood) 



Avoroco Coot per 
School 



Avorooo Coot per 
School 



Instruction by Satellite (10) 


$19,994 


* 11, 675 


OSU (4) 


$13,183 


$ 6,463 


SERC (4) 


$20,558* 


$15,580* 


TI-IN (2) 


$32,490 


$16,240 


Audiographic Tele-learning (4) 


$23,177 


$ 7,676 


Digital Interactive TV (5) 


$29,502 


$ 17,625 


Analog Interactive TV (4) 


$6Q,7P6 




Total Costs (23) 


$682,984 


$257,118** 


Average across all technologies: 


$29,695* 


$ 12,244* 



Totel Esti meted Cost of $786,258* $386,240* 

having implemented DL in the 
current 28 adopter districts 



* does not include the $35,000 state fee assessed 
**based on 21 schools providing data 



An Assessm ent of Traditional vs. PL Student Achievement 

Because the North Dakota OL courses in Spanish and German both 
enrolled the largest number of students and were taught utilizing 
different technologies, it was believed that those courses would be the 
most logical for assessing OL student achievement through a standardized 
test. 

In searching for such a measure to assess student achievement, two 
instruments were located. The "National Spanish Examination" and the 
"American Association of Teachers of German (AATG) Level I test, Form 
B". 

In studying the following tables, several precautionary statements 
should be taken into, account: 

(1) While the National Spanish Examination does report a national 
average (mean) for those high school students taking each test 
level, the AATG German test does not collect student test data 
.1. that level. The only basis for comparison of German test 
scores is. with a University of Colorado-Boulder pretest of Level 
1 Test, Form B. 

(2) The AATG German test is designed for secondary school 
students, to be taken at the end of their first year of German 
instruction. The pretest, however, with University of Colorado 
students was administered on the premise that a first-level 
secondary school course roughly corresponds to a first-semester 
college course. Exception could certainly be taken to this 
assumption. 

(3) Any comparison of Digital l-TV Spanish scores with other 
technologies should take into account that the Digital courses 
were in operation for only one semester, while all other courses 
were two-semesters in length. 

As can be seen in the following table, Analog l-TV and OSU 
Instruction by Satellite percent scores on the German test differed by 
only 1 percentage point. Neither, however, favorably compare with the 
University pretest average of 81%. Possible interpretations of this 
seemingly large gap, however, are several: 

CI) There may be a significant difference in student achievement 
attributable to method of instruction, i.e., traditionally taught 
students may indeed learn more than distance learning students. 
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(2) it could be purported that, as mentioned above, a comparison of 
a 1st semester college course with an Introductory high school 
course is not a fair comparison of amount or focus of materia] 
covered. 

(3) Finally, it could be suggested that a national standardized test, 
in order to accurately measure achievement assumes that e 
national curriculum is in place, in the case of the Analog l-TV 
and OSU German courses, both utilize non-traditional 
curriculums, designed specifically for their individual courses 
and do not rely, to any real extent, on what might be considered a 
traditional curriculum. It is therefore, highly questionnable 
whether such a national test can indicate anything other than the 
extent to which student achievement conforms to the curricular 
focus on which the test was based. For example, the OSU course 
is heavily culturally oriented, while the AATG test would not 
reflect any student knowledge of German culture. 

Comparison of student test scores on the National Spanish 
Examination reveal scores strikingly similar to the national average. 
Discounting the Digital l-TV students, who had completed only a one- 
semester course, the range of the average Analog l-TV,TI-IN by Satellite 
and Audiographic scores was only eight percentage points. Of particular 
note is the identical average score of Analog l-TV Spanish students with 
the national average for the 1990 test. 

It is therefore concluded that, on the basis of this data, there does 
not appear to be any discernible difference between distance learning and 
traditional foreign language student achievement attributable to the 
specific distance learning technologies utilized. 
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TABLE 55 

ACHIEVEMENT TEST SCORES BY TECHNOLOGY 



] { ) ( H) North IMknt.i Distimrn l M.trninn '.tuiiij 
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DISTANCE LEARNING STUDENT PROFILE BY TECtwLOGY 



If indeed, as pointed out above, the technology perse does not appear 
to significantly affect student achievement, how might the characteristics 
individual students bring with them to the DL course interact with the 
technology implemented? We will begin with a description of DL student 
characteristics and, in the following section, attempt to relate those 
characteristics and others to performance on the standardized tests in 
German and Spanish. 

Grade Level 

Although nearly one-half of all DL students (48%) were high school 
seniors and one fourth (25%) were juniors, differences among technologies 
were obvious. While underclasspersons comprised 28% of Interactive TV 
and 30% of Instruction by Satellite students, only 7% of Audiographic 
students were freshmen or sophomores. Conversely, upperclasspersons 
(juniors or seniors) comprised 72% of l-TV students, 70% of Instruction by 
Satellite students, and 92% of Audiographic students. 

Class Rank 

Two thirds of all DL students were in the top half of their 
graduating class. By technology, however, 60% of l-TV students ranked in 
the top half as compared to 80% of Instruction by Satellite and 90% of 
Audiographic students. 

Graduating Class Size 

The graduating class size of DL students ranged from 5-314. (Keep 
in mind that some students were enrolled in larger schools from which DL 
teaching and courses originated.) Average graduating class size was 
nearly identical for Audiographic and l-TV Uudents at 32 and 33, 
respectively. Instruction by SatelMe students' graduating class size 
averaged 91, however, ranging from 13 forTI-IN students to 147 for SERC 
students. 

Grade Point Average 

Thirty-nine percent (39%) of DL students had GPA's of 3.5 or above 
on a 4.0 scale, with an equal percentage (39%) having GPA's of 2.0 or 
below. By technology, however, both Instruction by Satellite and 
Audiographic students were more likely to have. higher GPA's than their I- 
TV counterparts. 
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Motivation Level 

On a scale of 1-5, DL students were assessed by their 
administrators as to their level of motivation. Overall, 64% of the 
students were considered highly or somewhat motivated, i.e., ranking of 1 
or 2. Only 12X were considered highly or somewhat unmotivated, i.e., 
ranking of 4 or 5). Level of motivation did not vary significantly, by 
technology, except for the 22% of Instruction by Satellite students who 
were thought to be highly or somewhat unmotivated. This can be 
explained, presumably, by the students' frustration with the incomplete 
implementation of the technology and lack of coordinator support as 
evidenced by survey findings. 

If one were to attempt to predict student achievement, based solely 
on the student characteristics cited above, one might expect Audiographic 
students to have the edge because of the greater enrollment of upperclass 
students, the higher percentage of students ranked in the top half of their 
cless, and a greater percentage of students with high GPA's. 

Instruction by Satellite students appear to have the advantage of 
coming from larger schools and— at least by conventional wisdom 
standards— might have broader curricular backgrounds. They also have 
higher GPA's and higher class ranks than their l-TV counterparts, but 
lower motivation levels. 

Interactive TV students might be predicted to do less well, because 
of lower GPA's and a smaller percentage of students ranked in the top half 
of their class. 

The following table shows the relative advantage end disadvartages 
to hypothesized student achievement with each technology. 

TABLE 56: Relative Student Characteristic Advantages and Disadvantages 
ta Hapethesized Student Achievement b« Tecbaaloqq 

Audiographic 

Student Characteristics Interactive TV Instruction bu Satellite Tele-learning 

Grade Level -- — Advantage 

Class Rank Disadvantage Advantage Advantage 

Graduating Class Size -- Advantage 

GPA Disadvantage Advantage Advantage 

Motivation Level — Disadvantage 
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RELATIONSHIP OF STUDENT CHARACTERISTICS 
TO ACHIEVEMENT TEST SCORES 

Class Rank 

There appears to be a significant relationship between students' 
class rank and their individual scores on the national standardized tests 
in Spanish and German. Eighty-six percent (Q6%) of the students ranging 
in the top 5% of their graduating class scored above the state mean on the 
tests, while 0% of those graduating in the bottom 10% of the class did so. 

Of course, one would logically assume that student rank in their 
graduating class would be associated with how well they would do in any 
course, whether or not it was via distance learning. 



TABLE 57: DL St use at Class Raak Student Achieve meat Test Scores 

ia Germaa & Ssaaisb 



Abovs State 
Mean 



* of DL Students bu Class Rank 
Top Top Top Top Top Top Top 
5% 6-10* 11-20* 21-30* 51-50* 51-75* 76-89* 



86* 78* 



56* 



Belov State 

Mean 14* 223. 44* 

100* 100* 100* 



60* 



40* 
100* 



55* 



45* 
100* 



32* 



68* 
100* 



33* 



67* 
100* 



Lover 
10* 

0* 



100* 
100* 



Cumulative GPA 

Student cumulative grade point averages appear not to be significantly 
associated with DL student test scores in German and Spanish except where 
student GPA's fall below 2.00 on a 4-point scale. It should be remembered, 
however, that ability alone does not necessarily explain high or low GPA. 
Other factors such as student motivation may have an equally or more 
important part. 



TABLE 58: Student GPA's b« Achievement Test Scores in German & Spaaish 



* of PL Students bu Grade Poi nt Average 
3.75- 3.50- 3.00- 2.50- 2.00- 1.50- 
4.00 3.74 5.49 2.99 2.49 1 .99 



1.00- 0.00- 
1 .49 0.99 



Above State 
Mean 

Belov State 
Mean 



46* 



100* 



71* 41* 41* 44* 



0* 



0* 



59* 56* 100* 100* 
100* 100* 100* 100* 100* 100* 
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Student Motivation Level 

Administrators' assessment of student motivation level proved to be 
less than a perfect predictor of student success as well. Fifty-six 
percent (56%) of those considered to be somewhat or highly motivated 
scored above the state mean on the German or Spanish Achievement Test, 
while 18% of those considered to somewhat or highly unmotivated did so. 
It is interesting, however, that there is a direct relationship between 
level of motivation and percent of students scoring above the state mean, 
that is, the greater the level of motivation (as assessed by 
administrators), the higher the probability of scoring above average on the 
test. At either extreme of the motivation continuum we see that nearly 
three-fourths (738) of those students considered as highly motivated 
scored above the state mean while all students (100%) considered to be 
highly unmotivated scored below the state mean. 

TABLE 59: Student Metivatiea leva* aa Achievement Test Scares 

in German & Spanish 



% of PL Students bu Motivation Level Assessed bu Administrators 

Highly Somewhat Marginally Somewhat Highly 

Motivated Motivated Motivated Unmotivated Unmotivated 

Above State 

Mean 73% 47% 42% 29% 0% 
Below State 

Mean 27% 55% 58% 71% 100% 

100% 100% 100% 100% 100% 



Grade Level of Enrolled Students 

DL students taking the German and Spanish tests were evenly 
distributed among all four high school grade levels. Very little difference 
existed among students by grade level with the exception of Seniors who 
scored significantly lower than other students and sophomores who scored 
somewhat higher than other students. No inherent reason appears to exist 
for differential achievement by grade level apart from other student and 
course characteristics. 
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TABLE 60: Studeat 6reee Level 03 Achievement Test See res 
In Germen & Spanish 



* of PL Students bu Grade Level 

9th Grade t Oth Grade 11th Grade 1 2th Grade 

Above State 

Mean 53* 6555 54* 32* 
Belov State 

Mean £22. 55% 46* 68* 

100* 100* 100* 100* 

Student Characteristics Considered Important biLStudents 

When asked to indicate which of the following characteristics they 
thought were most helpful in the distance learning course, students most 
often indicated "taking responsibility for their own learning" and "a 
willingness to work on their own". Eighty-eight percent (88*) of the 
students scoring above the state mean thought a willingness to work on 
their own was most helpful while 77% of those who scored below the state 
mean believed likewise. Similarly, 88* of those scoring above the mean 
thought that the ability to take responsibility for their own learning was 
helpful in the course, while 83* of those scoring below the mean felt so. 

No real difference between perceptions of those scoring above or 
below the state mean existed with the exception of intelligence level. 
Sixty-one percent (61*) of those scoring above the mean felt that an 
above average intelligence level was helpful in the DL course, while only 
37* of those scoring below the mean believed likewise. 

TABLE 61: Characteristics Tbeeeht by Stneents ta be Mast Helpful In a Distance 
Leer nine Coarse be Achievement Test Scares In German & Spanish 





* of Students 


* of Students 




Above State Mean 


Below State Mean 


Tain ng responsi bility for thei r own lear ni ng 


88* 


83* 


Willingness to work on their own 


88* 


77* 


A high level of motivation 


79* 


76* 


An outgoing personality 


61* 


65* 


An interest in or aptitude for use of technical equipment 53* 


44* 


An above average intelligence level 


61* 


37* 
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Notably absent from the current research study is any data relating 
student learning style to achievement in DL courses. While collection of 
such data was beyond the scope of the current study, it cculd certainly be 
hypothesized that differential learning sLyles may account to some extent 
for differential success levels among students. Differences in learning 
styles, however, can account for differential success in the traditional 
classroom as well, when those differences are not taken into account. 

In summary then, we find that class rank, student motivation level, 
and— in the absence of explicit learning style data— a desire to take 
responsibility for their own learning and a willingness to work on their 
own are the characteristics most highly associated with above average 
achievement test scores. 
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RELATIONSHIP OF COURSE CHARACTERISTICS TO 
ACHIEVEMENT TEST SCORES 



In addition to the use of educational technology in instruction and 
the characteristics of individ»al students in the courses, one additional 
factor must be viewed as a potential variable in student achievement— the 
characteristics of the DL courses themselves, including implementation 
practices. 

Implementation of OSU German by Satellite Course Components 

OSU German by Satellite is unique in its multi-directional approach 
to instruction. Apart from the two day per week broadcasts via satellite, 
♦he German course is intended to involve students in three separate 
computerized drill and practice software progi^ams and a computerized 
Voice-Based Learning System. Use of audiotapes both with the Worschatz 
software and with the lab/workbook are also included as intended course 
components. The extent to which all components are indeed implemented 
(and utilized) appears to be critical to student achievement. 

TABLE 62: Effect of Implementation/Student Utilization of 
Noa- Broadcast Coarse Components in OSU German bg Satellite 
oa Student Standardized Test Scores 



Above State Mean 
Below State Mean 



Student Use of Dasher Software (grammar) 



Never 
0% 

7% 



RarelH 
OS 

36% 



Once/mo or more Total 
100% 10055 



57% 



100% 



Above State Mean 
Below State Mean 



Student Use of Warscbatz Software (vocabulary) 



Never 
0% 

50% 



Rarelu 
0% 

14% 



Once/mo or more Total 
100% 100% 



36% 



100% 



Above State Mean 
Below State Mean 



Student Use of Diktat Software (dictation) 



Never 
0% 

57% 



Rarelu 
50% 

7% 



Once/mo or more Total 
50% 100% 



3G% 



100% 
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TABLE 62 (COMT ): Effect of ImpleoMatattea/Statfeat Utlllzatlea of 
Noa- Broadcast Coarse Cea^eeats in OSU drm be Satellite 
oe Stadeat Staadardlzed Test Scares 



Student Use of Voice- Based Leerafaf Sestcai 



Above State Mean 
Balow State Mean 



Above State Mean 
Below State Mean 



Above State Mean 
Below State Mean 



Never 
62* 



Rarelu 
23% 



Once/moor mora Jojal 
40% 100% 



15% 



100% 



Student Use of AeOtetepes v/Werecaatz softvare 



Never 
50% 

62% 



Rarelu 
10% 

15% 



Once/moor more Total 
40% 1 00% 



23% 



100% 



Student Use of Aedleteees Provided v/Lae Boole 



Never 
0% 

38% 



Rarelu 
9% 

31% 



Jnce/moor more Jojal 
91% 100% 



31% 



100% 



All OSU German by Satellite students scoring above the state mean 
on the national test utilized both Dasher and Worschatz once per month or 
more as compared to 57% and 36%, respectively, of those students scoring 
below the state mean. Both Diktat and VBLS usage among students scoring 
above the state mean was markedly higher than for those scoring below 
the mean, as was use of audiotapes both with the Worschatz software and 
with the lab/workbook. 

In terms of other OSU German by Satellite course components- 
accessing the professor via electronic mail, calling in to the professor 
during broadcasts, or calling in either at other times of the day or from 
home at night— individual contact with the professor was virtually 
nonexistent among all students. 
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TABLE 63: Effect of Instructor Access Ceneeeeets 
it OSU Gormen bf Satellite or Steeent Stencsrclzee: Test Scores 



Student Use of Electronic Moil 



Above State Mean 
Below State Mean 



Above State Mean 
Below State Mean 



Above State Mean 
Below State Mean 



Above State Mean 
Below State Mean 



Never 
90* 

92* 



farelu 

10* 
8* 



Once/moor more Total 
0% 100* 



0* 



100* 



Student Cell -I as Deri no Brceecests 



Never 
100* 

100* 



Rarelu 
0* 

0* 



Once/moor mora Total 
0* 100* 



0* 



100* 



Student Cell- 1 es Deri no; Other Tines of Dee 



Meyer 
90* 

69* 



Rarelu 
10* 

23* 



Once/mo or more Total 
0* 100* 



8* 



100* 



Student Cell -las From Heme et Nlfht 



Never 
90* 

100* 



Rarelu 
10* 

0* 



Once/mo or more Total 
0* 100* 



0* 



100* 



Student Pe rception of Whether Improvements are Needed In the Course 

Little difference existed between the perceptions of those students 
who scored above or below the state mean on the German and Spanish 
Achievement Tests with respect to whether thiu, felt there were aspects of 
the course which needed to h e improved upon or changed. Fifty-four percent 
(54%) of those scoring above the mean felt improvements were needed; 48% 
of those scoring below the mean felt changes were in order. 

Importantly, this would seem to indicate that student achievement 
was not affected by technical or other course problems perceived by 
students. 
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TABLE 64: statfeat Perceptlsa af Waataar Cearsa lawavaawats art tliiiii a« 
Acaiavaawat Tast Scares ia Germaa * Saaalsa 



1 % Believing Improvements % Believi no. improvements 

are Needed ere NOT Needed 

Above State 

Mean 54% 46% 

Belov State 

Mean 48% 52% 

Performance of Classroom Tasks in a Distance Learning Elassronm 

One of the major factors in which distance learning classes differ 
from traditional classrooms is the extent to which students are directly 
responsible for what are normally considered "teacher duties". Students 
were given a series of tasks which might normally be the responsibility of 
the teacher in a traditional class and were asked to identify who, if 
anyone, performs the task in their distance learning class. The following 
table relates the performance of those tasks to student achievement test 
scores. 

Perhaps of greatest importance in the study is the apparent effect 
of teacher task performance on student achievement test scores in 
German and Spanish. The following table shows that where someone— 
either the remote teacher, the classroom coordinator, or other students- 
perform each of the tasks listed below, there is a clear association with 
improvement in achievement test scores. Where someone identifies and 
solves individual DL student problems, achievement test scores rise an 
average of 38£. Of somewhat less, but still significant, impact is the 
effect of performance of the other teacher tasks on student achievement. 
Who performs the task is not as important as whether the task is 
performed. 

Because of the relatively small numbers involved, it is not possible . 
to determine within the scope of this study the cumulative effect of 
performance of each task on student test scores, however it is 
hypothesized that a cumulative effect is present, i.e., that those students 
for whom more tasks are performed will score higher on achievement 
tests than those students for whom fewer tasks are performed. 

Different technologies may require different application of this 
finding, that is, while Instruction by Satellite classes may necessitate a 
full-time classroom coordinator In order to Insure performance of these 
tasks, interactive TV students may rely on the remote teacher for the 



ERIC 



79 

70 



majority. As one con quickly see, a state regulation requiring that a 
certified teacher be in the local classroom does not insure that any of the 
tasks will be carried out. it is therefore instructive to state policy 
makers that more attention and emphasis need be put on the tasks 
associated with student success than on the regulation of a classroom 
supervisor who may or may not perform the necessary support role. 

TABLE 65: The Effect ef Perfcrmcnce ef Selected Teacher Teste* In DL clees on 
Achieve Meet Test See res in German * S penis* 

Average Percentage Increase in Student Achievement Test 
Scores with Performance of Task by Either the Remote 
Teacher , the Classro om Coordinetor . or other Students 



Identifies and solves problems 38ft 
individual students may be 
having vith the course 



Maintains discipline 


28ft 


Answers simple questions or helps 


24ft 


students find answers to problems 




Learns the course material along 


23ft 


with the students 




Troubleshoots problems with 


22ft 


equipment 




Constructs quizzes or worksheets 


21ft 


to assist student learning 




Participates or watches all classes 


16ft 


along with the students 




Motivates student to do well 


lift 
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MEASURES OF STUDENT SUCCESS IN DISTANCE LEARNING COURSES 



While the study has consistently used standardized test scores as 
the basis for comparing student achievement given different input 
variables, there are several other "measures of student success" which 
when taken as a whole, in addition to test scores, may give a more valid 
interpretation of which method(s) of distance learning appeaKs) to be 
more conducive to student success. 

Perception of "Amount Learned" in PL Courses 

One factor which serves as a subjective measure of student success 
is the students' perception of the "amount they have learned". This was 
operational zed by asking students to indicate whether they had learned "a 
great deal", "an acceptable amount", "not as much as I think I should have", 
or "not much at all". Among the three major types of DL technology, 
students believed they learned most in Interactive TV classrooms— 83% of 
the students indicated having learned "a great deal" or "an acceptable 
amount". Audiographic tele-learning ranked second with 64% of the 
students having learned "a great deal" or "an acceptable amount". 
Instruction by Satellite ranked last with 54% similarly rating their 
knowledge. 

If we look at the other end of the continuum, we find that while 15% of 
the Instruction by Satellite students believe they learned "not much at 
all", 0% of the Audiographic students felt likewise. 

TABLE 66: Antount Learned In Students' Perception 

NOT AS MUCH 





A 


AN ACCEPTABLE 


AS 1 THINK 1 


NOT MUCH 


INTERACTIVE TV 


GREAT DEAL 


AMOUNT 


SHOULD HAYE 


AT ALL 


34% 


49% 


11% 


6% 


DIGITAL! -TV 


31* 


41% 


18% 


10% 


ANALOG l-TY 


35% 


53% 


8% 


4% 


INSTRUCTION BY SAT 


15% 


39% 


31% 


15% 


TI-IN* 


38% 


50% 


12% 


0% 


OSU 


12% 


36% 


39% 


12% 


SERC 


13% 


38% 


28% 


21% 


AUDIOGRAPHIC 


28% 


36% 


36% 


0% 



TELE- LEARNING 



* Based on only 2 TI-IN sites ope rating in state 
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In comparing student, coordinator, and instructor perceptions of 
"amount learned" by DL students in North Dakota, we see strikingly similar 
results. With the exception of Audiographic Tele-learning, rankings 
appear to coincide. In terms of perceived amount learned by students, i 
-TV ranked first, Audiographic Tele-learning ranked second, and 
Instruction by Satellite ranked third. Within the technologies, Analog I- 
TV appears to slightly outrank Digital I -TV; and SERC and OSU fall behind 
TI-IN in terms of perceived amount learned. 

TABLE 67: STUDENT, INSTRUCTOR, AND COORDINATOR PERCEPTION OF 
AMOUNT LEARNED BY DL STUDENTS 



Digital l-TY 
Analog I -TV 
TI-IN by Satellite 
OSU by Satellite 
SERC by Satellite 
Audiographic Tele-learning 



Ranking by Technology* j 

Average 

Student Rank Instructor Rank Coordinator Rank Ranking 

3 3 1 (3)2.33 
2 1 3 (2)2.00 

1 NA** 2 (1)1.5*** 

6 NA** 6 (6)6.00 

5 NA** 5 (5)5.00 

4 1 4 (4)3.00 



* based on % assessi ng students as "havi ng learned a great deal ' 
** i instructors not located i n North Dakota were not surveyed 



*** 



based on only 2 TI-IN sties vith a total of 8 student responses. 



Second Semester Grades Received bu DL Students 

Grades received by DL students for their second semester distance 
learning courses also reflect a higher percentage of "A"*s among 
Interactive TV students than among students in other technologies. Little 
difference existed, however, among l-TV and Instruction by Satellite 
students when looking at the number of "A" and "B" students combined. 
Eighty-three percent (83S) of l-TV and 80S of Instruction by Satellite 
students received semester grades of "A" or "B", compared with 56% of 
Audiographic students. 

It should be pointed out, however, that no common grading standards 
existed across the three technologies nor across the schools involved. 
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TABLE 68: Sec*atf Semester Grafts fer DL Stetfeats »a Tecaaaieaj 





1 

A 


a 


%OfSI 

C 


a 


F 


Total 


Interactive TV 


54% 


29* 


13* 


3% 


1% 


100% 


Digital 


46% 


19% 


24% 


5% 


5% 


100% 


Analog 


57% 


32% 


10% 


2% 


0% 


100% 



Instruction na Satellite 


44% 


36% 


6% 


10% 


4% 


100% 


Tl-IN* 


63% 


25% 




13% 




100% 


OSU 


23% 


31% 


8% 


31% 


8% 


100% 


SERC 


48% 


41% 


7% 




3% 


100% 


Aeeieerapnic Tele-learain§ 


29% 


29% 


21% 


7% 


14%* 


100% 



♦baaed on 2 of 1 4 students 



Student Desire to Enroll in Another Distance Learning Course 

Another measure of "student success" Is the extent to which 
students indicate they would enroll In another distance learning course. 
Ninety-three percent (93%) of l-TV students said they would enroll In 
another DL course compared to 7\% of Audiographic and 51% of Instruction 
by Satellite students. 

Again, when looking at the different systems within each 
technology. Digital l-TV ranks slightly ahead of Analog l-TV, while OSU 
Instruction by Satellite falls behind SERC in terms of student willingness 
to enroll in another DL course. Tl-IN heads the Instruction by Satellite 
systems in terms of student satisfaction, but the small number of Tl-IN 
students enrolled in North Dakota prevents the association of a high level 
of confidence with these findings. 



TABLE 69: Weald Stoeents Enrell in A net her Distance Learning Caarse? 





YES 


m 


HOT SURE 


Interactive TY 


93% 


6% 


IS 


Digital 


96% 


4% 




Analog 


92% 


6% 


1% 


Instruction bg Satellite 


51% 


49% 




Tl-IN 


75%* 


25%* 




OSU 


41% 


59% 




SERC 


54% 


46% 




Auelaarapbie Tele-learning 


71% 


29% 





* based on only 8 students 
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Student Perception of Whether PL Course Improvements are Needed 

Students exhibited differential perceptions of whether there were 
improvements needed in their DL course by the technology utilized. Tl-IN 
by Satellite students found least fault with their DL courses with only one 
of the eight students (13%) indicating that course improvements were 
needed as compared with 31% of Analog l-TV students, 63% of Digital I- 
TV students, 66% of OSU by Satellite students, 68% of SERC by Satellite 
students, and 100% of Audiographic Tele-learning students. 



TABLE 70: Stadeat Perception ef Whether Itapreveawats are Needed 
is the Distance Learaiaf Coarse 



* of Students 





YES 


NO 


Interactive TV 


40% 


60* 


Digital 


63* 


27* 


Analog 


31* 


69* 


Instruction ha Satellite 


62* 


38* 


TI-IN 


13* 


87* 


OSU 


66* 


34* 


SERC 


68* 


32* 


Aadiea raphic Tele-leer nina 


100* 


0* 



Student Achievement Test Scores 

As discussed previously, student scores on the national standardized 
tests in German and Spanish indicated little difference among the three 
technologies with respect to student test performance. Audiographic tele- 
lebrning students scored 5 points above Instruction by Satellite students 
overall, with l-TV students scoring two points above Instruction by 
Satellite students. 
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TABLE 72: CtiMied OL Stadtat Rasalts aa Naflaaal Exaariaattaas 

ia Saaaiaa aad Germa 

*of Students for 
Whom Teat Results 
Rav Score** are Available 



INTERACTIVE TV 


33 


71 


DIGITAL 


25* 


14 


ANALOG 


35 


57 


INSTRUCTION BY SATELLITE 


31 


27 


OSU 


31 


25 


TI-IN 


39 


2 


SERC 


(No students) 




AUDIOGRAPHIC TELE- LEARNING 


36 


27 



* Students i n these schools ted only 1 semester of a 2 semester course. 
** Rev scores have been adjusted for differential numbers of questions on Spanish and German 
tests. Adjusted scares have been rounded to the nearest whole number. 

When breaking test results down by specific language, no difference 
appears between Interactive TV and Instruction by Satellite students with 
respect to German test scores 

Analog l-TV students in Danish scored slightly higher than TI-IN by 
Satellite students who scored slightly higher than Audiographic students, 
the differential being a total of only 5 points. 

Direct comparison of Analog with Digital l-TV student test scores is 
not possible, as the Digital courses were in operation for only one 
semester, while the Analog students had completed a two-semester 
course. 

Beyond the previous disclaimers, it is possible to conclude, although 
somewhat tenuously, that: 

(1) national achievement tests are probably a better measure of 
what is taught in a course rather than how well it is taught; 

(2) The slight difference in student scores among technologies 
Infers little, If any, difference in how well students learn with 
each technology. , 

(3) Apparently more Important than the technology used Is the 
curriculum offered, the teacher's ability to convey knowledge or 
Induce learning, and the students' "study/work ethic". This 
position Is strongly supported by the Audiographic Tele-learning 
course in Spanish, whose instructor obviously compensated most 
well for some rather serious ioChnologlcal disadvantages. 
Inability to clearly hear or communicate with the Instructor at 
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all times seen. ^y had no effect on student test scores, i.e., 
the instructor was able to insure learning in spite of, rather 
than because of, the technology. (It should be pointed out that 
there is not an inherent inferiority in the Audiographic Tele- 
learning technology, rather the telephone lines linking some 
North Dakota schools were the source of the audio/data 
transmission problems.) 



TABLE 72: STUDENT RESULTS UN SPANISH AND GERMAN 
NATIONAL ACHIEVEMENT TESTS BY SUBJECT AREA 



SPANISH 



GERMAN 





Adjusted Rev 
Scores** 


* of Students 


Adjusted Row 
Scores** 


* of Students 


INTERACTIVE TV 

DIGITAL 


34 

25* 


(33) 
(14) 


31 


(38) 


ANALOG 


42 


(19) 


31 


(38) 


INSTRUCTION BY SATELLITE 

osu 

TI-IN 
SERC 


35 (2)*** 

39 ( 2)*** 
(No students) 


31 (25) 
31 (25) 

(No students) 



AUDIOGRAPHIC TELE-LEARNING 36 



(27) 



* Students i n these schools had only 1 semester of a 2 semester course. 

** Rev scores have been adjusted for differential number of questions on Spanish and German 

tests. Adjusted scores have been rounded to the nearest whole number. 
*** Numbers too small to represent a significant finding. 



9 

ERJC 



86 

77 



Summary of Measuros of Student Success in PL Courses 

If we look at a composite of the five measures of student success in 
DL courses available to us— instructor, coordinator, and student 
perception of amount learned; second semester course grades; percentage 
of students who would enroll in another OL courses; student perception of 
whether improvements are needed in the course; and standardized test 
scores in German and Spanish—we are able to see some very distinct 
patterns emerge, while not relying on any single measure of student 
success. 

The composite ranking detailed in the table below shows TI-IN 
consistently ranking first amon* the success variables with the exception 
of Variable 3— a higher percentage of students said they would not enroll 
in another DL class, indicating some degree of frustration with the course. 

Analog and Digital technologies ranked second and third respectively 
in the composite ranking, with little difference among them. Both l-TV 
technologies scored highest in terms of percentage of students indicating 
they would enroll in another DL course. It could be inferred that it caused 
less student anxiety or frustration because this technology most nearly 
approximated that of a traditional class, i.e., there was immediate audio- 
visual access to the instructor. 

Audiographic Tele-learning ranked fourth with fairly uniform 
rankings across Variables 1, 2, 3, and 4. Its top ranking was on 
standardized test scores, indicating a high level of student knowledge 
gained in spite of technological problems involved in the course. 

Ranking lowest of the technologies studied were SERC and OSU by 
Satellite, again with fairly uniform individual rankings on the student 
success variables, SERC by Satellite s chief attribute lay in the course 
grades achieved by students. With OSU by Satellite, rankings on both the 
standardized German test score and on student perception of whether 
course improvements are needed were somewhat higher than on other 
variables. 

At the risk of repetitiveness, it must always be remembered that 
educational technology serves only as well as it is implemented. Clearly 
a major problem with OSU by Satellite was the extent to which it was 
only partially implemented in some schools, thus incurring greater 
student frustration, a lower perception of amount learned, and lower 
student grades. 
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TABLE 73: Seancr* «f Student Success Meeseres in DL Ccerses 



Y1 



Y2 



Y3 



V4 



I rat, Coord, & 
Student Percep- 
tion of Amount 
Lcernedi 



INTERACTIVE TV 

DIGITAL 3 

ANALOG 2 

INSTRUCTION BY 
SATELLITE 

OSU 6 
TI-IN 1 
SERC 5 

AUDI06RAPHIC 4 
TELE- LEARNING 



Y5 




4 

2 



6 
1 

3 



Would students 
enroll in 
another 
DL courses 



Student Percep- 


Net! Test 


tion of Whether 


Scores- 


DL Course Im- 


German 


provements ere 


end 


^1 — i- -» - 


Spamsh5 



RANK 



I 

2 



6 
3 
5 



3 
2 



4 
1 

5 



4 



Composite 
Rank 



-* (3) 2.75 
3 (2) 2.20 



(6) 5.20 
(1) 1.40 



— *** ( 5 ) 4.50 
2 (4) 4.20 



1 based on % respondi ng to learned a greet dee? " 

2 based on % receiving "A" grades 

3 based on % respondi ng "Yes" 

4 based on % \ ndicati ng i mprovemertts are needed i n DL course 

5 based on adjusted rev scores on "Combined DL Student Results on National Examinations 
i n Spanish and German" 

* score not comparably based on two semesters' coursevork, therefore omitted 

** based on only 8 students 

*** courses not taken in Spanish or German 
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RESEARCH SUMMARY, CONCLUSIONS, AND RECOMMENDATIONS 



Twenty-seven public schools in North Dakota participated in this 
research study which attempted a cross-technology comparison of the 
three major types pf distance learning— Instruction by Satellite, 
Audiographic Tele-learning, and Interactive Television. A total of 23 
courses were offered enrolling 334 students during the second semester, 
1989-90, through six distance learning technology sub-types: Analog and 
Digital l-TV, Audiographic Tele-learning, and Instruction by Satellite 
through TI-IN Network in Texas, Oklahoma State University's Arts and 
Sciences Teleconferencing Service (OSU-ASTS), and the Satellite 
Educational Resources Consortium (SERC) in North Carolina. 

Each technology sub-type represented a different approach to the 
common goal of providing an alternative method of expanding the 
curriculum in schools who, restricted by size and small population 
density, are not able to offer a comprehensive curriculum. 

Distance learning in its several different forms clearly was viewed 
by the adopting North Dakota schools as a necessary and valuable solution 
to the need for affordable curriculum expansion. In its neophyte stage, 
acceptance of DL was widespread, criticisms were selective, and the 
future was painted as uniformly positive. Students reiterated the tone of 
the school administrators, but left ample room for questionning the 
appropriateness of DL technology for all students. Learning style 
differentials, just as in a traditional classroom, may limit the uniform 
applicability of DL technologies, but the adopting schools hold no apparent 
aspirations, as critics and teacher organizations often charge, for 
broadening the application of DL to general or core curriculum classes. 
Distance learning in North Dakota is seen as the means to curriculum 
equalization, allowing small schools a similar opportunity for providing 
student access to advanced or special courses, 

DL Student Attitudes and Characteristics 

• Q4% enrolled because they were interested in the subject 

• 95% of the DL students had plans for attending college 

• 70% of the schools placed no restrictions on who was allowed to 
enroll in the DL courses 

• 6 \% of the students had GPA's of 3.00 or above (on a 4.00 scale) 
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• 58* found no differences between the amount of homework given 
between DL and traditional classes; 15$ thought DL classes had more 
homework, while 60$ reported spending between 1-2 hours per week 
on OL homework 

• 56$ thought DL classes were the same level of difficulty as 
traditional classes; 34$ though OL classes were harder 

• 86$ of the DL students felt a willingnessness to take responsibility 
for their own learning was most helpful in a DL class 

• 43$ of the DL students reported little or no interaction with the 
remote DL instructor 

• 79$ said they would enroll in another DL course if given the 
opportunity 

School/Community Attitudes Regarding Distance Learning 

• All administrators favored or strongly favored their local DL 
programs as did 96$ of the student bodies, 83$ of the communities, 
and 61$ of the faculties 

• 96$ of the administrators were satisfied or very satisfied with the 
quality of DL instruction; 64$ were satisfied with the costs involved 

The Future of Distance Learning 

• All DL administrators indicated they would recommend their 
particular technology to other districts 

• All administrators saw DL serving a long-term nebu for expanding the 
curricular offerings in small schools 

• 91$ of the administrators said the number of DL courses would be 
expanded in their schools within the next 1-5 years 

• 83$ of administrators said they planned to broaden the usage of the 
technology within the next year to include either teacher inservice, 
community/business use, administrative/interschool use, and/or 
student enrichment programming 

• 78$ said they would likely use multiple DL technologies within the 
next five years 

• 94$ believed the need for DL would continue in their school 

moeaimenls to Expansion of Distance Learning 

• 94$ of administrators felt the limitations of the local school 
district budget was a major impediment to expansion; 88$ cited the 
lack of outside funding 

• 75$ felt state level policies and regulations would impede expansion 
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Characteristics of Classroom Coordinators/Supervisors 

• 57% were full-time employees of the school as teachers and/or 
administrators 

• 22% indicated receiving extra compensation for their DL supervision 
duties 

• 52% simultaneously performed other duties during the OL class 

• 59% had had a moderate or greater amount of experience with 
computers 

• 52% of DL coordinators reported having received some training 
regarding the DL program 

• Notably lacking, however, was training in the role of classroom 
supervisor among 70% of the DL coordinators 

DL Program Characteristics 

• Nearly two-thirds of the schools (65%) have modified their school 
calendar and 61% have modified their class bell schedule to 
accomodate the OL classes 

• Only 30% of the schools' class bell schedules, however, perfectly 
coincide with the DL class schedule. As an accomodation, some 
schools release students early from or are admitted late to other 
classes; others tape live broadcasts for delayed viewing. 

• In 22% of the schools students miss up to 10 minutes of the DL class 
because of overlap with other classes 

• 57% of the schools had students who dropped a DL course 

• Primary reasons for dropping the course, as assessed by the 
coordinator, were the difficulty level of the course and the lack of 
student motivation to put forth the effort required of them 

Attitudes and Characteristics of Distance Learning Instructors 

• The majority of DL instructors wf.re experienced teachers, having 
more than 1 1 years teaching experience 

• 75% of the remote instructors were full-time teachers 

• The instructors' technological knowledge or experience was not 
extensive; with the exception of VCR's, tape recorders, and 
computers, most had had minimal experience with technical 
equipment 

• All DL instructors received some form of training in that role 

• Half of the instructors felt that teaching is mora exciting in a DL 
class 
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• Two-thirds felt that they could teach "better" utilizing the distance 
learning's educational technology 

• 75% saw little difference in carrying out a DL vs. a traditional 
teaching role 

• Two-thirds believed that there is less student-teacher interaction in 
a DL class and that it is more difficult to know if stude».*.s 
understand what is being taught 

• All instructors did not believe that discipline is more of a problem 
in DL classes (Remember that only l-TV and Audiographic Instructors 
were surveyed.) 

• 75% use a written curriculum in both their traditional and DL classes 

• All instructors believed that flexibility, organizational skills, and an 
outgoing personality are essential attributes of DL instructors 

• 75% believed that they covered essentially the same material at the 
same pace in either traditional or DL classes 

• Two-thirds of the instructors believed there were aspects of the 
course or technolcgy which needed to be improved upor. 

• All felt that the widespread use of their particular technology would 
grow 

Necessity for Comple te Implementation of Course Components 

Differences in technology require differences in implementation 
practices. "»"he major problem with Instruction by Satellite in North 
Dakota is Ue failure of schools to implement all components of the 
program. The existence of a full-time classroom coordinator to insure all 
software and computer components are regularly used, to facilitate 
contact with the instructor, and to deal with equipment operation is 
essential to student success. A critical difference between Interactive 
Television and Instruction by Satellite is the extent of flexibility in how 
the course can possibly be implemented. Little leeway exists for schools 
in implementing Digital or Analog l-TV— it is virtually an "all or none" 
technology. With Instruction by Satellite, especially OSU's Instruction by 
Satellite program, however, there are multiple components and pieces of 
equipment which schools may implement to varying degrees. This 
incomplete implementation clearly was the major factor in student 
opinion— 59% of Instruction by Satellite students felt there were aspects 
of the course which needed improvement. In addition Instruction by 
Satellite students found the problems to be much more severe than did 
students involved with the other two technologies. 
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Identification/Certification of Classroom Coordinators 

No direct comparison of student achievement in classrooms with 
coordinators who were certified teachers (in some area) as compared to 
coordinators who were not certified teachers was possible in the scope of 
the study. However, it is very clear from the data that the existence of 
someone performing the duties of classroom coordinator is directly tied 
to student achievement. Average student socres on national standardized 
Spanish and German tests were from 1 1-38* higher for those students for 
whom coordinator duties were being carried out by someone. Duties 
commonly associated with a classroom coar iinator were more often 
carried out by the DL instructor in l-TV classes, making the added role of 
classroom coordinator much less essential than in either Satellite or 
Audiographic technologies. The role of coordinator is seen as most 
essential in Instruction by Satellite classes where the lack of teacher- 
student interaction is most pronounced and where such a coordinator is 
needed to insure the implementation and usage of the various course 
components. 

It is therefore concluded that the existence of a classroom 
coordinator who is available on a full-time basis to assist students and 
participate in all classes is far more important than part-time 
supervision by a certified teacher or administrator. In addition, 
rudimentary knowledge of the subject matter, e.g., someone who speaks 
German, appears to be a more important coordinator attribute than teacher 
certification in another area. 

Need for Sta te Education Aoencu Role As Technoloou Information and 
Technical Assistance Provider 

Thirty percent (30*) of North Dakota administrators initiating a 
distance learning program explored no technology other than the one 
adopted. Virtually all districts (93£) depended on outside consulting 
services in implementing the DL technology chosen, either through the 
Department of Public Instruction, an equipment dealer or supplier, a local 
telephone company, a private consultant, or a regional University. 
Seventy percent (70*) of the administrators encountered technical 
problems with the DL equipment installed. These findings indicate a need 
for readily and widely available information on and technical assistance 
for the DL options. Costs of implementation were shown to vary 
dramaticly even within technology sub-types, indicating a further benefit 
to be achieved from an independent, non-commercial information source to 
which local schools might have ready access. (North Dakota has 
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added a technology resource person to their staff, a model which other 
states could certainly follow.) 

The Role of the Classroom Coordinator 

In comparing student and coordinator perceptions of who performs 
specific tasks in the DL classroom, several observations can be made: 

(1) As would be expected, the percentage of coordinators who 
report that they themselves perform each task is slightly 
higher than the students' account of supervisor/coordinator 
performance of the same duties. 

(2) Student and coordinator perceptions involving coordinator 
learning of the course material along with the students or 
coordinator participation in all classes are nearly idential. 

(3) Coordinators tend to allocate more responsibility for carrying 
out tasks to the remote teachers. Students tend to believe that 
the remote teachers do less than coordinators indicate. 

(4) a validity check of student vs. coordinator perception? 
indicates nearly identical percentages on teacher performace 
of two cbvious tasks— administering and grading of tests. 

(5) A reasonable explanation for variances in student and 
coordinator perceptions lies in the liklihood that coordinators 
respond on the basis of having performed any single task for 
any student. Students., on the other hand, are more likely to 
respond based on their own individual experiences. It is 
therefore logical that a small discrepancy would occur 
between student and coordinator percentages on any task which 
would be performed for or with individual students. Indeed, 
when comparing percentages, we find that very little 
discrepancy occurs when looking at group-oriented tasks such 
as administering/grading tests, participating in/watching all 
classes, constructing quizzes, etc. 

Remote teachers in l-TV classes significantly downplayed the role 
of the classroom coordinator as disciplinarian. Only Q% of the instructors 
indicated that discipline is carried out by the coordinator as compared to 
34% in the coordinator's opinion and 41 % in the students' opinion. I-TV 
instructors similarly downplayed the coordinator role in troubleshooting 
problems with equipment. 

Even moreso than students, l-TV instructors severely critiqued the 
role of the coordinator with respect to identifying or solving individual 
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student problems and helping students find answers to problems. (Do keep 
in mind, however, that the role of the coordinator in the i-TV classroom is 
much different than that in the Satellite or Audiographic classroom.) 

This further supports the finding that the role of classroom 
coordinator should be adapted to the specific OL technology implemented. 
Ready access to technology-specific coordinator training is highly 
desirable, with particular emphasis on the role of the coordinator in the 
classroom. 



Student Characteristics Associated with Student Achievement 
The probability of greater student achievement is enhanced by: 

• a higher student class rank 

• a student GPA above 2.00 ( on a 4.00 scale) 

• a high level of student motivation 



PL Course Characteristics Associated with Student Achievement 
The probability of greater student achievement is enhanced by: 

• complete implementation and student utilization of all 
course components 

• the performance of the following tasks by someone, e.g., 
the remote instructor, the classroom supervisor, or other 
students: (Tasks are listed in order of priority) 

identifying and solving individual student problems in the course 
maintaining discipline 

ansveh ng si mple questions or hel pi ng students 
learning the course material along with the students 
troubleshooting problems with equipment 
constructing quizzes or worksheets to assist student learning 
participating in or vatching all classes along with students 
moti vati ng students to do well 

Student Achievement in Distance Learning Classe s 

There is no evidence to suggest that the achievement of DL students 
is less than that of traditionally taught students. The interaction 
between specific student and individual course craracteristics, the 
technology sub-type and method of implementation, however, prevents a 
clear prescription for one technology type over another when looking only 
at student achievement. 

First of all, it is clear that all students do not succeed equally well 
given a DL instructional format, just as all students do not succeed 
d M ually well given limited instructional methods in a traditional 
classroom. It is apparent, although beyond the scope of current 

o 95 
ERIC 86 



investigation, that learning style has an effect on student success in DL 
courses. 

Secondly, the degree to which the technology most closely mimics a 
traditional classroom— that is, it allows for immediate or nearly 
immediate student-teacher verbal and visual interaction— reduces the 
level of student frustration and increases the willingness of students to 
enroll in other DL courses. This statement must be qualified, however, by 
the fact that actual student achievement can be just as high or higher in 
non-interactive forms of DL, given high student motivation, a study/work 
ethic, or adequate student support through enhancement of the role of the 
classroom coordinator. 

Certainly a major outcome of this study is the finding that, if fully 
implemented with an adequate student support network, instruction via 
distance learning is a workable, productive means of offering advanced or 
special classes to students. How well each individual student does in the 
DL class, however, is further dependent on the individual student's 
character sties. 

In order to insure maximum student success in DL course tJwee 
elements must be in place: 



Full i mplementatiwi Student attrl butes of higher 

of the technology and An adequate student class rank, CPA above 2.0, 

utilization of all support system 1 n high student motivation, and 
course components the remote classroom avT" -ness to take respon- 
bility for v ie's own learning 



(1) There must be full implementation of the technology and all course 
components; 

(2) There must be an adequate student support system in the remote 
classroom geared specificly to the technology sub-type utilized; and 

(3) Students selected for DL course enrollment should have a high class 
rank, a GPA above 2.0, be highly motivated, and exhibit a willingness 
to take responsibility for their own learning. 

This is not to say, however, that all three elements must be fully 
operative in order for students to learn or for a course to be successful. 
Some students will succeed regardless of whether any support network 
exists or whether the course is fully implemented or not. It is just as 
likely, however, that an unmotivated student with a GPA uf 1.5 will not 
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succeed in a partially implemented class with no student support system 
available. 

It is concluded, therefore, that as the existence of any one element 
decreases, greater attention to the other other two elements will yield 
improved chances for student success. For example, the chances for 
success of an average student with a mid-level class rank whose 
academic motivation leaves something to be desired can be enhanced by a 
supportive remote classroom coordinator who understands the need to 
participate in all classes, insure usage of all course components, and 
intervene as individual student problems or questions emerge. 

An Assessment of Technology Sub-Times 

With attention having been given to the intervening variables 
affecting student success, the composite ranking of the technology sub- 
types below yields a reliable assessment of the various distance learning 
technologies operative in North Dakota. 

When combining the issues of cost, student achievement (test 
scores, grades, and perceived amount learned), coordinator and 
administrator satisfaction with the technology, frequency of student- 
teacher interaction, and existence of technical or other problems, Analog 
Interactive Television, TI-IN by Satellite, and Digital l-TV rank at the top. 
Audiographic Tele-learning ranks at the mid-level with OSU and SERC by 
Satellite ranking last. 

A cursory look at cost effectiveness shows that the three most 
expensive technology sub-types— Analog l-TV, TI-IN by Satellite, and 
Digital l-TV— also rank highest on the composite assessment score. OSU 
by Satellite, while least expensive to implement and maintain, also 
ranked low on the composite score. Audiographic Tele-learning, with both 
relatively low initial and subsequent costs, ranked in the middle on the 
composite score. SERC by Satellite appears to be least cost effective in 
that its costs are high (given the state fee) and its composite ranking is 
lowest. 

With the exception of cost, the technology sub-type ranks on 
individual assessment measures are strikingly similar, making such 
conclusions more reliable than if based on a single measure. 
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TABLE 74: COMPARISON RANKS OF DISTANCE LEARNS TECHNOLOGY SUB-TYPES--A COMPOSITE ASSESSMENT 



National student, Willingness pfJ^lL 

Standard- Coordinator of Admlnl- J^jjj 

SfrU? i ,Mt « UCt0r , StUdent5t0 5trator Coordinator Frequency VmpnwE 

? , ; C< ! Pt10 ^ f *° A Enr ? 1 «WW«on impression ofStodent- ZtTare 

Spanish by Students DL Course DLCoursel Course 



Initial 
Imple- 
menta- Estimated 
tion Annual 
Costs Cost 



per par 

Interaction the Course Grades School School 



INIIRACTIVE 



Utftal --* 


3 


1 


3 


2 


2 


3 


4 


Analog 3 


2 


2 


2 


1 


3 


2 


2 


INS1RUCTION 
BY 

SATELLITE 
















TI-IN 1** 


1 


3 


1 


3 


6 


1 


1 


OBU 4 


6 


6 


4 


6 


5 


4 


6 


SERC — *** 


5 


5 


6 


5 


4 


5 


3 


AUTO- 
GRAPHIC 2 
TEII- 


4 


4 


5 


3 


1 


6 


5 



4 

6 



5 
1 
3 

2 



LEIINING 



1 based on 1 5 items relating to course satisfaction 

2 SEIC costs 1 nclude $35,000 state fee; fee scheduled to increase substantially 



• scores not comparabl g based on two semesters' coursevork, therefore omitted 

o based on only 8 students 

ERJC > courses not taken 1 n Germen or Spanish 

V'"0 



5 
3 



4 

! 
6 
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Need for Continued Systematic Distance Learning Research 

Little has been done in the way of evaluative distance learning 
research. Clearly, more is needed on a multi-state or national level in 
order to be able to statistically deal with some of the more refined 
questions raised by this study: 

(1) What interaction exists among student characteristics, course 
components, and student support systems by technology sub- 
type? Is it indeed possible to compensate for minimal criteria 
in one area through special attention to criteria in other areas 
regardless of technology implemented? How is this interaction 
affected by differences in technology sub-type? 

(2) What effect do student learning styles have on ability to 
succeed in distance learning formats? 

(3) Does the- performance of various "teacher tasks" by a classroom 
supervisor or other person yield cumulative improvement in 
student achievement, i.e., improve achievement additionally 
with each task performed? 

(4) Does an investigation of distance learning student achievement 
in other than foreign language classes result in similar 
findings? 

(5) How does full implementation and utilization of all course 
components affect the composite assessment of Instruction by 
Satellite vis-a-vis other forms of distance learning? 

Recommen dations to Previous or Potential Distance Learning Adopters 
The primary purpose behind this study was to assist previous or 
potential adopters in initiating or improving the implementation of 
distance learning programs as well as to provide a research base to state 
education agencies and others formulating distance learning policy. The 
following recommendations are the result of these research findings: 
(1) Local school access to non-commercial, reliable information 
concerning distance learning is imperative. Lacking a national 
or regional network to whom this responsibility might fall, 
state departments of education or public instruction must 
assume that responsibility. 
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(2) Administrators should base the decision to initiate a DL program 
on an identified need(s) in a specific curricular area(s), 
involving the faculty in the need identification process. Faculty 
response to distance learning will be facilitated through their 
early involvement in the decision-making process. 

(3) The process of choosing a specific OL technology should be made 
at the level of the individual school rather than at the state 
level and should involve a conscious, locally-informed decision, 
based on a combination of factors, including. 

• the courses tc be offered 

• the number and type of students to be served 

• a full knowledge of the course components involved in 
the technology 

• the ability to incorporate all course components into the 
local program 

• the ability to incorporate an adequate student support 
network 

• the financial resources available 

(4) The assumption that all distance learning technologies are "plug- 
in" technologies must be avoided. Each technology varies with 
respect to its flexibility in implementation. While interactive 
TV is largely an "all or none" technology, (i.e, it is either 
operative or it is not), Instruction by Satellite involves a much 
more multi-faceted implementation with varying degrees to 
which any component may be implemented. In order to gain 
maximum educational benefit from the technology chosen, it 
must be technically operative under local conditions and all 
intended components must be fully implemented and utilized. 

(5) The clustering of several schools around a particular DL 
technology both facilitates the planned implementation of the 
program in the schools and serves as a support network during 
stages of problem resolution. 

(6) The role of the classroom coordinator should be ascertained 
prior to course operation and should be delineated based on the 
technology chosen. 
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(7) It is highly recommended that state education acencies rethink 
traditional blanket requirements concerning teacher, grade- 
level, or subject-area certification of DL coordinators and 
concentrate more on educating district adopters regarding the 
differing coordinator roles required by different technologies. 
The existence of a classroom coordinator who is available en a 
full-time basis to assist students and participate in all classes 
appears to be of more benefit than the part-time supervision by 
a certified teacher or adminstrator. The educational value of a 
full-time classroom coordinator, however, varies by the 
technology implemented. 

(8) Distance learning methodologies are not alike and therefore 
attempts *.o regulate their operation must take that diversity 
into account. To attempt to regulate distance learning along the 
lines of traditional accreditation and certification procedures 
may indeed short-circuit a valid school restructuring process. 

(9) Training must be acquired or provided for every person actng as 
a classroom coordinator. A state-level training program for 
classroom coordinators (differentiated by technology sub-type) 
should delineate the specific duties to be performed by the 
coordinator in the classroom, cover the extent of supervision 
and involvement required in the class, and provide training on all 
technical equipment. The role of the state education agency in 
coordinating technical training with third-party providers 
should be encouraged. 

(10) In lieu of a state education agency certification requirement for 
DL Coordinators, district compliance with respect to classroom 
supervision could be ascertained in the form of an annual 
"Distance Learning Supervision and Coordination Plan", thus 
focusing requirements away from paper certification and toward 
actual provision of student services. 

(11) Training should be provided, as well, for local teachers serving as 
remote DL instructors. Beyond the obvious technical training 
needed, DL instructors should be provided with practice teaching 
opportunities utilizing the technology. In addition, exposure for a 
block of time with an experienced DL instructor could focus on 



ERIC 




differences in instructional methods, attention to student on-task 
behavior, resolution of student problems, and relationship to the 
classroom coordinator. Continued access to an experienced DL 
instructor, either through periodic workshops or phone access, 
would be of great benefit. State education agencies could be of 
immeasurable assistance in helping to coordinate such training 
with regional colleges or universities with identified expertise. 

(12) Ready access to technical support should be in place prior to the 
emergence of any problems. All participants in the program 
should know whom to contact at which location at what times in 
order to quickly resolve any problems which are surely to 
emerge at one time or another. 

(13) Continued local monitoring of distance learning programs in terms 
of type of students enrolled, satisfaction with the program, 
measurement of student success criteria, and role of the classroom 
coordinator will insure continued program success while providing 
a sound information base from which program modifications can be 
made as necessary. Compilation of evaluative data within clusters 
of school adopters can yield further comparison data upon which 
program improvements can be made. 

The future of Distance Learning in this country is tied directly to the 
ability of state education agencies and other educational policy-makers to 
facilitate the educational restructuring process. The ability of local 
teachers and administrator's to adequately implement and operate DL 
programs is essential. Equally vital, however, is the need for state education 
agencies to provide informational and technical assistance to schools while 
selectively aiming their regulatory function toward encouraging 
educationally productive practices. Continued regulation of distance learning 
based on traditional criteria will serve neither to speed the large:' school 
restructuring process nor insure improved educational benefits to students. 
One by one, experience by experience, educators are beginning to understand 
that distance learning is not a "threat" to the teaching profession; now they 
must also learn that with the freedom to teach in new and exciting ways 
comes the responsibility to wisely and judiciously utilize the technology for 
student benefit. Most appropriately said, in the words of a North Dakota 
Digital l-TV instructor, "distance learning is not for every student, nor is it 
for every teacher". 
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